-- Logs begin at Fri 2022-09-02 08:26:23 UTC, end at Fri 2022-09-02 09:29:41 UTC. -- Sep 02 09:00:20.899453 dv-cinder-855359-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 09:00:20.908095 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 09:00:20 2022] *** Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: nodename: dv-cinder-855359-2-iscsi Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: machine: x86_64 Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: clock source: unix Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: pcre jit disabled Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: detected number of CPU cores: 4 Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: current working directory: / Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: detected binary path: /usr/bin/uwsgi-core Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: your processes number limit is 47680 Sep 02 09:00:20.910044 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: your memory page size is 4096 bytes Sep 02 09:00:20.910899 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: detected max file descriptor number: 2048 Sep 02 09:00:20.910899 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: lock engine: pthread robust mutexes Sep 02 09:00:20.910899 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: thunder lock: enabled Sep 02 09:00:20.910899 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 09:00:20.910899 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 09:00:20.949059 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: Python main interpreter initialized at 0x5602a65909c0 Sep 02 09:00:20.949059 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: python threads support enabled Sep 02 09:00:20.949059 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: your server socket listen backlog is limited to 100 connections Sep 02 09:00:20.949059 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: your mercy for graceful operations on workers is 90 seconds Sep 02 09:00:20.949401 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 09:00:20.949483 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: *** Operational MODE: preforking *** Sep 02 09:00:20.949697 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: *** uWSGI is running in multiple interpreter mode *** Sep 02 09:00:20.949697 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: spawned uWSGI master process (pid: 105594) Sep 02 09:00:20.949871 dv-cinder-855359-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 09:00:20.951219 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: spawned uWSGI worker 1 (pid: 105595, cores: 1) Sep 02 09:00:20.951344 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: spawned uWSGI worker 2 (pid: 105596, cores: 1) Sep 02 09:00:20.951418 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 09:00:21.607459 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 09:00:21.616784 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 09:00:22.689638 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:00:22.689638 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: from cryptography.utils import int_from_bytes Sep 02 09:00:22.690267 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:00:22.690267 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: from cryptography.utils import int_from_bytes Sep 02 09:00:22.705661 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:00:22.705661 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: from cryptography.utils import int_from_bytes Sep 02 09:00:22.706095 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:00:22.706095 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: from cryptography.utils import int_from_bytes Sep 02 09:00:25.172161 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:00:25.172728 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:00:25.172927 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:00:25.173284 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:00:25.173541 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:00:25.173925 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.174249 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.174418 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:00:25.174785 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.174875 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:00:25.174967 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.175207 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.175310 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:00:25.175518 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.175612 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:00:25.175807 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:00:25.175910 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.176137 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.176231 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.176464 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.176557 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.176722 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.176807 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.177032 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.177131 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.177352 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-2-iscsi {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.177438 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.177673 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.177758 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.177975 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.178070 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.178284 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.178370 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.178601 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.178693 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.178854 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.178940 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.179190 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.179281 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.179514 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-2-iscsi {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.179662 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.179832 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.180009 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.180119 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.180429 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.180547 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.180744 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.180865 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.181036 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.181154 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.181354 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.181474 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.181656 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.181782 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.181961 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.182159 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.182265 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.182467 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.182575 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.182768 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.182896 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.183098 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.183227 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.183426 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.183623 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-2-iscsi {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.183738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.183956 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.184056 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.184251 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.184369 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.184592 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.184686 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.185241 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.185349 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.185544 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.185642 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.185853 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.185948 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-2-iscsi {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.186171 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.186271 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.186503 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.186607 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.186811 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.186904 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.187154 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.187244 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.187481 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.187570 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.187797 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.187891 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.188114 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.188201 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.188414 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.188501 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.188720 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.188813 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.189024 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.189111 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.189340 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.189435 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.189641 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.189728 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.189942 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.190042 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.190190 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.190278 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.190493 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.190579 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.190810 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.190903 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.191153 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.191297 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.191457 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.191554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.191713 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.191867 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.191959 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.192094 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.192269 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.192363 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.192585 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.192673 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.192886 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.192974 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.193193 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.193287 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.193438 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.193525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.193684 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.193774 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.193999 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.194095 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.194314 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.194408 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.194618 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.194720 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.194924 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.195029 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.195249 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.195349 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.195553 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.195640 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.195855 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.195951 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.196156 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.196243 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.196455 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.196541 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.196756 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.196851 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.197069 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.197156 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.197373 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.197458 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.197689 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.197776 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.197991 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.198087 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.198305 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.198391 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.198620 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.198713 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.198927 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.199013 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.199256 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.199347 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.199561 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.199647 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.199868 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.200441 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.200694 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.200779 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.201011 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.201099 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.201329 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.201426 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.201579 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.201675 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.201884 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.201973 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.202187 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.202284 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.202499 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.202594 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.202801 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.202903 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.203127 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.203219 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.203375 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.203478 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.203671 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.203759 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.203972 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.204057 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.204285 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.204383 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.204585 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.204672 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.204882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.204967 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.205182 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.205268 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.205472 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.205559 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.205771 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.205856 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.206067 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.206154 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.206367 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.206451 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.206743 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.207518 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.207679 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.207828 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.207975 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.208113 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.208249 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.208397 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.208550 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.208708 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.208854 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.210748 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.210957 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211153 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211259 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211357 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211438 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211517 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211594 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211681 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211770 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211852 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.211943 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212018 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212084 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212169 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212251 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212338 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212418 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212495 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212572 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212656 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212751 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212830 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212915 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.212994 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213078 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213157 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213243 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213322 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213403 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213481 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213557 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213643 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213723 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213800 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213876 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.213954 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214038 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214128 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214208 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214407 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214497 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214614 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214701 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214795 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214876 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.214962 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.215090 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.215192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.215391 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.215518 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.216225 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.216341 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.216519 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.216645 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.216822 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.216951 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.217118 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.217267 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.217432 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.217600 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.217748 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.217935 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.218052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.218276 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.218362 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.218623 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.218728 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.218915 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.219004 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:00:25.219271 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.219361 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.219593 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.219691 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.219905 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.220000 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.220220 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.220307 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.220544 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.220633 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.220855 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.220941 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.221166 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.221252 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.221472 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.221565 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.221784 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.221870 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.222099 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.222183 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.222406 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.222494 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.222723 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.222824 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.223033 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.223141 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.223374 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.223462 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.223685 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.223780 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.224000 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.224094 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.224310 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.224411 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.224625 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.224764 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.224931 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.225030 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.225234 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.225320 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.225548 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.225635 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.225872 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.225968 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.226186 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.226280 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.226491 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.226578 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.226808 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.226903 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.227140 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.227233 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.227452 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.227539 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.227794 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.227890 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.228111 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.228197 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.228416 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.228509 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.228725 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.228814 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.229033 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.229120 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.229355 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.229441 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.229666 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.229755 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.229970 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.230057 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.230279 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.230364 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.230582 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.230676 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.230888 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.231031 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.231392 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.231542 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.231667 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.231753 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.231959 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.232047 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.232301 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.232436 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.232613 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.232702 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.232931 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.233026 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.233245 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.233342 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.233557 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.233653 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.233865 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.233952 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.234165 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.234259 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.234468 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.234563 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.234774 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.234873 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.235091 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.235195 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.235401 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.235495 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.235698 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.235785 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.236001 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.236097 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.236301 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.236388 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.236608 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.236695 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.236909 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.236998 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.237221 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.237315 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.237533 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.237620 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.237831 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.237918 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.238138 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.238264 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.238444 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.238532 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.238750 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.238837 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.239055 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.239158 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.239385 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.239474 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.239685 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.239774 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.239988 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.240073 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.240292 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.240386 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.240593 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.240688 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.240893 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.240978 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.241206 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.241301 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.241507 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.241659 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.241813 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.241899 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.242111 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.242274 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.242405 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.242516 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.242715 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.242802 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.243023 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.243176 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.243357 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.243445 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.243663 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.243748 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.243972 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.244064 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.244289 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.244384 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.244596 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.244682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.244902 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.244990 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.245216 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.245301 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.245517 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.245604 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.245827 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.245915 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.246131 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.246225 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.246437 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.246524 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.246738 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.246826 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.247082 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.247170 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.247389 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.247487 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.247687 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.247781 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.247988 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.248076 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.248287 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.248381 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.248590 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.248677 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.248888 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.248973 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.249189 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.249290 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.249491 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.249578 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.249790 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.249883 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.250085 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.250179 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.250402 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.250490 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.250710 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.250796 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.251011 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.251115 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.251337 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.251424 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.251638 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.251726 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.251978 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.252066 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.252280 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.252367 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.252607 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.252695 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.252918 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.253006 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.253229 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.253322 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.253538 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.253625 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.253844 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.253938 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.254159 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.254246 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.254466 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.254559 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.254771 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.254859 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.255113 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.255204 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.255410 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.255512 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.255716 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.255802 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.256022 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.256117 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.256322 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.256417 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.256631 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.256717 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.256952 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.257040 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.257259 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.257354 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.257575 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.257661 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.257872 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.257958 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.258186 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.258283 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.258496 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.258583 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.258805 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.258892 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.259135 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.259237 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.259446 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.259534 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.259755 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.259841 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.260065 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.260169 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.260372 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.260466 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.260675 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.260761 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.260982 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.261069 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.261286 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.261373 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.261594 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.261680 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.261897 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.261994 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.262195 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.262284 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.263016 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.263171 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.263367 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.263462 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.263699 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.263787 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.264009 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.264105 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.264311 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.264398 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.264624 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.264723 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.264930 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.265024 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.265238 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.265334 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.265549 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.265636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.265854 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.265954 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.266158 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.266245 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.266460 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.266546 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.266766 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.266865 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.267090 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.267190 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.267397 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.267484 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.267698 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.267786 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.268004 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.268089 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.268307 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.268392 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.268611 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.268705 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.268910 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.268997 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.269206 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.269291 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.269518 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.269606 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.269822 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.269909 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.270123 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.270210 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.270425 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.270610 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.270728 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.270814 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.271030 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.271219 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.271362 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.271449 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.271679 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.271766 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.271982 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.272078 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.272280 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.272366 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.272579 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.272673 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.272898 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.273048 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.273215 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.273334 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.273510 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.273598 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.273807 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.273902 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.274107 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.274195 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.274418 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.274503 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.274730 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.274819 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.275027 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.275159 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.275358 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.275446 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.275674 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.275769 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.275982 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.276069 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.276285 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.276371 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.276589 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.276677 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.276895 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.276988 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.277204 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.277298 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.277510 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.277597 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.277818 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.277905 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.278670 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.278778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.278985 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.279130 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.279320 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.279408 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.279625 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.279768 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.279932 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.280022 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.280241 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.280326 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.280552 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.280804 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.280892 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.281134 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.281228 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.281444 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.281530 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.281756 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.281850 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.282099 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.282311 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.282407 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.282640 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.282727 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.282953 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.283041 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.283302 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.283411 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.283637 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.283738 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.283953 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.284050 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.284254 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.284340 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.284558 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.284645 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.284868 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.284964 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.285172 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.285297 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.285477 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.285571 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.285779 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.285866 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.286076 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.286161 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.286374 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.286460 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.286674 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.286760 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.286972 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.287057 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.287298 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.287384 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.287608 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.287696 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.287907 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.288001 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.288209 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.288296 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.288505 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.288601 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.288805 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.288898 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.289115 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.289210 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.289416 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.289502 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.289718 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.289805 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.290015 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.290109 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.290335 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.290423 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.290638 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.290724 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.290935 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.291033 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.291261 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.291351 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.291562 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.291650 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.291905 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.292001 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.292206 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.292293 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.292528 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.292616 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.292831 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.292919 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.293132 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.293219 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.293431 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.293521 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.293762 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.293852 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.294071 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.294158 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.294371 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.294466 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.294675 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.294786 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.294983 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.295107 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.295389 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.295509 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.295671 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.295744 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.295905 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.295997 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.296207 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.296305 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.296509 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.296597 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.296815 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.296901 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.297116 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.297211 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.297414 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.297499 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.297710 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.297797 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.298008 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.298103 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.298309 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.298395 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.298607 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.298694 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.298904 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.298999 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.299228 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.299318 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.299535 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.299623 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.299833 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.299920 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.300127 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.300213 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.300424 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.300518 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.300721 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.300808 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.301024 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.301112 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.301320 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.301406 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.301621 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.301710 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.301921 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.302008 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.302218 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.302304 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.302519 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.302607 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.302815 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.302901 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.303136 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.303237 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.303439 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.303571 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.303747 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.303840 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.304047 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.304148 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.304354 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.304449 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.304654 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.304741 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.304952 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.305058 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.305253 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.305347 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.305557 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.305644 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.305861 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.305957 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.306157 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.306243 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.306454 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.306540 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.306750 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.306838 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.307046 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.307206 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.307368 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.307455 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.307709 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.307804 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.307966 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.308052 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.308268 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.308356 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.308571 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.308659 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.308872 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.308958 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.309169 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.309266 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.309511 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.309605 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.309819 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.310164 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.310371 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.310467 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.310673 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.310760 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.310972 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.311060 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.311338 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.311443 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.311640 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.311728 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.311947 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.312033 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.312260 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.312357 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.312566 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.312653 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.312877 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.312963 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.313183 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.313277 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.313489 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.313620 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.313789 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.313883 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.314086 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.314173 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.314397 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.314484 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.314704 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.314803 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.315013 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.315145 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.315345 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.315442 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.315648 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.315736 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.315967 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.316056 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.316269 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.316364 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.316574 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.316661 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.316880 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.316967 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.317187 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.317274 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.317494 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.317581 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.317791 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.317879 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.318096 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.318183 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.318399 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.318494 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.318707 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.318795 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.319011 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.319148 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.319344 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.319440 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.319646 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.319734 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.319953 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.320048 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.320255 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.320351 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.320554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.320641 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.320858 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.320955 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.321161 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.321261 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.321458 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.321554 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.321765 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.321896 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.322063 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.322158 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.322372 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.322460 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.322672 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.322760 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.322970 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.323110 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.323308 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.323427 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.323610 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.323738 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.323942 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.324030 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.324205 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.324337 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.324623 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.324719 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.325438 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.325538 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.325753 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.325841 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.326055 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.326151 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.326360 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.326472 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.326670 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.326783 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.326984 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.327093 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.327333 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.327421 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.327636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.327723 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.327984 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.328083 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.328294 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.328382 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.328617 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.328712 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.328920 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.329017 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.329218 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.329312 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.329515 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.329602 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.329819 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.329906 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.330124 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.330218 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.330426 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.330519 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.330727 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.330843 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.331027 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.331201 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.331372 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.331460 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.331670 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.331864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.331987 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.332174 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.332395 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.332490 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.332703 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.332791 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.333002 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.333092 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.333397 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.333498 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.333700 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.333787 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.334006 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.334101 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.334312 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.334398 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.334628 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.334789 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.334948 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.335035 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.335274 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.335361 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.335586 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.335691 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.335889 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.335976 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.336206 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.336293 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.336521 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.336620 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.336828 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.336922 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.337141 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.337237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.337442 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.337538 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.337764 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.337877 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.338086 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.338193 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.338396 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.338489 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.338725 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.338824 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.339050 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.339164 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.339378 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.339473 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.339688 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.339784 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.339992 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.340087 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.340296 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.340392 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.341145 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.341254 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.341459 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.341593 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.341810 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.341915 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.342122 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.342224 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.342420 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.342526 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.342719 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.342813 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.343022 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.343142 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.343356 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.343466 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.343666 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.343787 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.343972 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.344136 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.344272 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.344379 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.344575 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.344667 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.344895 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.344984 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.345192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.345291 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.345506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.345639 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.345812 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.345907 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.346115 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.346203 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.346416 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.346512 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.346714 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.346802 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.347034 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.347144 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.347362 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.347449 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.347668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.347768 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.347972 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.348073 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.348271 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.348367 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.348603 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.348689 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.348900 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.348988 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.349219 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.349307 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.349544 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.349641 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.349851 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.349950 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.350162 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.350255 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.350483 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.350570 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.353174 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.353287 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.353409 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.353517 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.353629 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.353750 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.353857 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.354021 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.354133 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.354238 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.354352 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.354460 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.354563 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.354675 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.354780 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.354884 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.355529 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.355617 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.355719 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.355798 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.355876 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.355969 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356094 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356204 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356288 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356367 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356455 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356546 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356628 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356754 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356843 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.356925 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357004 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357093 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357181 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357262 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357341 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357420 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357507 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357589 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357676 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357815 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357902 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.357983 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358072 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358161 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358242 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358327 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358408 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358487 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358575 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358656 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358735 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358815 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358894 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.358973 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.359125 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.359212 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.359389 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.359477 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.359701 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.359802 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.360014 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.360101 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.360329 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.360416 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.360685 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.360863 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.361000 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.361191 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.361314 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.361505 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.361629 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.361818 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.361948 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.362129 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.362441 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.362527 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.362752 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.362852 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.363063 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.363171 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.363402 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.363492 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.363712 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.363810 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.364022 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.364109 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.364334 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.364429 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.364646 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.364736 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.364955 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.365043 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.365265 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.365353 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.365572 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.365669 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.365883 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.365978 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.366197 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.366293 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.366509 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.366597 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.366838 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.366931 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.367180 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.367273 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.367488 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.367587 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.367798 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.367930 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.368110 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.368198 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.368423 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.368510 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.368732 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.368819 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.369044 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.369141 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.369352 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.369438 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.369662 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.369762 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.369970 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.370057 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.370276 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.370363 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.370581 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.370676 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.370889 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.370976 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.371228 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.371317 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.371542 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.371641 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.371878 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.371969 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.372191 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.372278 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.372500 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.372589 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.372809 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.372895 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.373143 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.373331 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.373463 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.373648 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.373783 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.373981 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.374097 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.374306 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.374402 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.374630 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.374909 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.374996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.375250 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.375340 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.375582 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.375679 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.375882 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.375969 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.376187 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.376327 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.376498 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.376587 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.376808 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.376895 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.377110 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.377205 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.377419 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.377505 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.377722 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.377809 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.378022 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.378117 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.378327 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.378413 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.378629 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.378717 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.378950 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.379181 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.379285 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.379530 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.379619 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.379845 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.379990 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.380169 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.380257 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.380490 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.380697 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.380807 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.381043 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.381142 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.381359 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.381447 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.381684 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.381779 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.381996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.382090 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.382307 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.382393 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.382613 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.382708 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.382910 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.382996 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.383235 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.383323 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.383547 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.383647 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.383855 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.383942 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.384157 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.384244 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.384454 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.384548 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.384752 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.384838 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.385059 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.385145 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.385362 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.385459 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.385660 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.385748 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.385957 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.386043 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.386253 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.386374 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.386552 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.386638 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.386853 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.386948 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.387175 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.387277 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.387988 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.388081 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.388296 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.388382 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.388594 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.388681 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.388896 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.388985 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.389195 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.389281 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.389492 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.389579 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.389802 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.389892 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.390102 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.390190 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.390411 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.390506 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.390711 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.390800 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.391019 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.391137 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.391349 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.391436 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.391667 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.391754 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.391977 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.392073 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.392293 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.392379 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.392597 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.392684 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.392899 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.393066 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.393213 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.393309 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.393523 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.393618 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.393843 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.394062 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.394158 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.394397 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.394491 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.394731 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.394887 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.395041 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.395152 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.395397 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.395620 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.395718 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.395958 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.396047 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.396281 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.396368 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.396603 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.396694 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.396914 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.397003 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.397223 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.397310 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.397523 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.397617 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.397829 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.397915 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.398138 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.398266 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.398446 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.398543 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.398754 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.398841 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.399059 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.399167 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.399386 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.399485 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.399696 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.399782 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.400003 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.400097 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.400307 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.400401 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.400611 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.400706 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.400916 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.401001 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.401224 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.401312 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.401527 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.401621 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.401835 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.401922 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.402142 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.402233 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.402451 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.402538 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.402761 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.402863 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.403120 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.403712 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.403926 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.404014 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.404237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.404338 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.404545 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.404634 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.404860 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.404954 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.405188 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.405286 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.405502 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.405589 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.405802 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.405891 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.406108 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.406204 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.406420 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.406515 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.406748 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.406838 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.407058 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.407180 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.407384 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.407472 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.407748 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.407842 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.408070 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.408167 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.408380 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.408470 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.408697 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.408784 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.409004 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.409093 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.409317 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.409404 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.409636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.409737 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.409944 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.410039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.410262 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.410349 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.410569 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.410669 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.410872 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.410960 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.411203 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.411307 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.411514 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.411611 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.411830 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.411918 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.412140 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.412229 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.412436 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.412524 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.412731 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.412818 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.413036 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.413122 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.413334 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.413428 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.413635 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.413729 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.413930 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.414017 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.414229 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.414323 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.414532 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.414619 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.414828 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.414915 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.415149 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.415250 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.415454 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.415585 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.415751 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.415847 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.416053 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.416140 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.416348 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.416442 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.416647 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.416743 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.416944 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.417032 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.417239 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.417325 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.417537 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.417633 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.417834 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.417921 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.418134 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.418223 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.418429 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.418524 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.422844 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.422956 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423041 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423203 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423306 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423390 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423470 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423550 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423630 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423709 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423801 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423883 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.423963 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424050 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424143 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424225 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424317 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424398 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424478 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424557 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424715 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424869 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.424953 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425040 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425121 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425212 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425301 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425389 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425470 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425549 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425635 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425705 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425780 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425867 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.425948 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426028 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426114 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426202 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426285 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426366 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426445 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426524 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426602 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426693 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426774 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426842 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426908 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.426994 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427114 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427210 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427294 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427381 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427463 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427542 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427622 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427714 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427804 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427886 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.427965 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.428044 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.428132 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.428214 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.428300 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.428380 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.428512 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.428683 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.428781 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.428992 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.429081 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.429300 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.429387 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.429616 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.429716 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.429930 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.430018 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.430240 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.430330 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.430558 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.430647 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.430874 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.430961 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.431248 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.431376 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.431562 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.431660 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.431867 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.431956 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.432194 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.432282 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.432518 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.432607 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.432831 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.432919 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.433138 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.433226 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.433383 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:00:25.433472 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.433791 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.434104 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.435210 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.435517 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:00:25.435758 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:00:25.587414 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO dbcounter [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Registered counter for database nova_api Sep 02 09:00:25.594719 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO dbcounter [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Registered counter for database nova_api Sep 02 09:00:25.608626 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_db.sqlalchemy.engines [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:00:25.614259 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_db.sqlalchemy.engines [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:00:25.615234 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writer thread running {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:00:25.620661 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writer thread running {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:00:25.672518 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.context [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77b482fe-72b8-4cea-95b2-9e3933054e02(cell1) {{(pid=105596) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 09:00:25.676446 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:00:25.676669 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.context [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77b482fe-72b8-4cea-95b2-9e3933054e02(cell1) {{(pid=105595) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 09:00:25.676865 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:00:25.678427 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:00:25.679194 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:00:25.679637 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:00:25.680548 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:00:25.681012 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:00:25.681575 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:00:25.682569 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:00:25.683302 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:00:25.683566 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO dbcounter [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Registered counter for database nova_cell0 Sep 02 09:00:25.683741 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:00:25.686469 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:00:25.688371 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO dbcounter [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Registered counter for database nova_cell1 Sep 02 09:00:25.688468 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO dbcounter [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Registered counter for database nova_cell0 Sep 02 09:00:25.692311 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO dbcounter [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Registered counter for database nova_cell1 Sep 02 09:00:25.696354 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_db.sqlalchemy.engines [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:00:25.697610 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_db.sqlalchemy.engines [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:00:25.699394 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_db.sqlalchemy.engines [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:00:25.704116 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writer thread running {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:00:25.704665 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writer thread running {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:00:25.706015 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_db.sqlalchemy.engines [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:00:25.706351 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writer thread running {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:00:25.846576 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writer thread running {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:00:25.852453 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO dbcounter [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Registered counter for database nova_cell0 Sep 02 09:00:25.855113 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO dbcounter [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Registered counter for database nova_cell0 Sep 02 09:00:25.859659 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_db.sqlalchemy.engines [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:00:25.863953 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writer thread running {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:00:25.864162 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_db.sqlalchemy.engines [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:00:25.868519 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writer thread running {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:00:26.202979 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: WARNING keystonemiddleware.auth_token [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:00:26.205144 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: WARNING keystonemiddleware.auth_token [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:00:26.210244 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: WARNING keystonemiddleware.auth_token [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:00:26.212421 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: WARNING keystonemiddleware.auth_token [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:00:26.550028 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: WARNING keystonemiddleware.auth_token [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:00:26.553465 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: WARNING keystonemiddleware.auth_token [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:00:26.555905 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: WARNING keystonemiddleware.auth_token [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:00:26.559442 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: WARNING keystonemiddleware.auth_token [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:00:26.561448 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602a65909c0 pid: 105595 (default app) Sep 02 09:00:26.563490 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:00:26.564671 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-affb91fc-97cc-4104-aed1-d3dcd745ebd5 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Sep 02 09:00:26.564989 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602a65909c0 pid: 105596 (default app) Sep 02 09:00:26.565078 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Fri Sep 2 09:00:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:01:43.940835 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:01:43.941976 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001945 Sep 02 09:01:43.942378 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:01:43.953490 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_api:SELECT=3 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:01:43.954408 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_cell0:SELECT=3 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:01:43.955730 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_cell1:SELECT=3 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:01:43.956539 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:01:44.822712 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8c7f3bd9-506b-448e-8de4-251526987229 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:01:44.854029 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8c7f3bd9-506b-448e-8de4-251526987229 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905596 Sep 02 09:01:44.854946 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1292 bytes} [Fri Sep 2 09:01:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:01:47.235969 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:01:47.237883 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-f7514829-b931-4703-b82e-e5f70d85a0ec None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 02 09:01:47.237883 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:01:47.683325 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-45aab396-07de-4dbf-830c-4c4ce16cca87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:47.732391 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-45aab396-07de-4dbf-830c-4c4ce16cca87 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488830 Sep 02 09:01:47.732956 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:01:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:01:47.747316 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_api:SELECT=3 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:01:47.748940 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_cell0:SELECT=3 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:01:47.750174 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_cell1:SELECT=3 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:01:47.751011 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:01:47.973807 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-e80d1c20-4e13-45f3-874b-af2746865e9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:48.039377 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-e80d1c20-4e13-45f3-874b-af2746865e9e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297980 Sep 02 09:01:48.040062 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1336 bytes} [Fri Sep 2 09:01:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:01:50.426402 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-45aab396-07de-4dbf-830c-4c4ce16cca87 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:01:50.427466 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-45aab396-07de-4dbf-830c-4c4ce16cca87 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 02 09:01:50.427866 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:01:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:01:51.088281 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-454770fc-663e-4dc1-81ed-52717f45f1a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "name": "ds512M"}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:51.126630 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-454770fc-663e-4dc1-81ed-52717f45f1a7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.692600 Sep 02 09:01:51.127484 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:01:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:01:51.139728 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-6fb151e4-4a61-443a-a8d8-f3f39fdfa271 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:51.174786 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-6fb151e4-4a61-443a-a8d8-f3f39fdfa271 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038763 Sep 02 09:01:51.175743 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1336 bytes} [Fri Sep 2 09:01:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:01:53.511678 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-454770fc-663e-4dc1-81ed-52717f45f1a7 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:01:53.512639 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-454770fc-663e-4dc1-81ed-52717f45f1a7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 02 09:01:53.513041 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:01:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:01:53.856648 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-cb3d1bda-7dab-4100-b71f-b5b01fcba3ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:53.874185 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-cb3d1bda-7dab-4100-b71f-b5b01fcba3ab admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.355291 Sep 02 09:01:53.874729 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:01:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:01:53.886837 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-caf017f2-7d7e-46cc-8643-42d79e39da97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:53.910231 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-caf017f2-7d7e-46cc-8643-42d79e39da97 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027212 Sep 02 09:01:53.910774 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1336 bytes} [Fri Sep 2 09:01:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:01:56.254256 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-cb3d1bda-7dab-4100-b71f-b5b01fcba3ab admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:01:56.255293 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-cb3d1bda-7dab-4100-b71f-b5b01fcba3ab admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 02 09:01:56.255696 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:01:56.723193 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-1bc6ba21-dfe2-400d-95cb-956a0d079bde admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:56.743489 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-1bc6ba21-dfe2-400d-95cb-956a0d079bde admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481521 Sep 02 09:01:56.747436 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:01:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:01:56.756841 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-54a88151-ffff-42a9-8009-e7095a4484b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:56.781912 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-54a88151-ffff-42a9-8009-e7095a4484b2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028749 Sep 02 09:01:56.782797 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1336 bytes} [Fri Sep 2 09:01:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:01:59.121063 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-1bc6ba21-dfe2-400d-95cb-956a0d079bde admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:01:59.122653 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-1bc6ba21-dfe2-400d-95cb-956a0d079bde admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 Sep 02 09:01:59.123047 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:01:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:01:59.572253 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-23e11fd4-9b70-446a-a6b9-8ad277191a1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:59.592106 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-23e11fd4-9b70-446a-a6b9-8ad277191a1c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462735 Sep 02 09:01:59.592866 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:01:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:01:59.604752 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-e9c18f69-a2aa-4a81-b89b-022ce465b996 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:01:59.631300 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-e9c18f69-a2aa-4a81-b89b-022ce465b996 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030110 Sep 02 09:01:59.632122 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1336 bytes} [Fri Sep 2 09:01:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:02:02.013795 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-23e11fd4-9b70-446a-a6b9-8ad277191a1c admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:02.014847 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-23e11fd4-9b70-446a-a6b9-8ad277191a1c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 02 09:02:02.015301 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:02.425471 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-d290975e-f201-41c8-9136-91298e7e7b78 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:02.451381 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-d290975e-f201-41c8-9136-91298e7e7b78 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.429930 Sep 02 09:02:02.451938 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1292 bytes} [Fri Sep 2 09:02:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:02:04.968812 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-23e11fd4-9b70-446a-a6b9-8ad277191a1c admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:04.969723 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-23e11fd4-9b70-446a-a6b9-8ad277191a1c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 02 09:02:04.970174 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:05.383433 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-8af86f19-4d25-4b0a-ac0f-f07a66e79f8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "id": "1", "name": "m1.tiny", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:05.402044 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-8af86f19-4d25-4b0a-ac0f-f07a66e79f8a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425769 Sep 02 09:02:05.402619 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:02:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:02:05.414717 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-90ad6c0c-5f7d-4db1-9f2b-7d584911c3ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:05.439746 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-90ad6c0c-5f7d-4db1-9f2b-7d584911c3ac admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028804 Sep 02 09:02:05.440626 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1333 bytes} [Fri Sep 2 09:02:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:02:07.773542 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-8af86f19-4d25-4b0a-ac0f-f07a66e79f8a admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:07.774560 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-8af86f19-4d25-4b0a-ac0f-f07a66e79f8a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 02 09:02:07.774964 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:08.161664 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-24a44ac0-e852-4662-b0b4-606140e091b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "disk": 20}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:08.181419 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-24a44ac0-e852-4662-b0b4-606140e091b9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.399842 Sep 02 09:02:08.181970 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:02:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:02:08.195270 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-7b80f29c-7461-435c-9d89-bb02e6d6030f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:08.219538 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-7b80f29c-7461-435c-9d89-bb02e6d6030f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028965 Sep 02 09:02:08.220142 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1333 bytes} [Fri Sep 2 09:02:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:02:10.579602 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-24a44ac0-e852-4662-b0b4-606140e091b9 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:10.580602 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-24a44ac0-e852-4662-b0b4-606140e091b9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 02 09:02:10.581012 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:02:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:10.987482 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-54071e78-4cd7-41bf-b771-3bc073506fdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:11.009372 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-54071e78-4cd7-41bf-b771-3bc073506fdb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.422449 Sep 02 09:02:11.010452 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:02:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:02:11.022759 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-1f39f723-f7e7-48f7-b0ca-3a6fcec96877 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:11.047534 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-1f39f723-f7e7-48f7-b0ca-3a6fcec96877 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028482 Sep 02 09:02:11.048420 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1333 bytes} [Fri Sep 2 09:02:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:02:13.426123 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-54071e78-4cd7-41bf-b771-3bc073506fdb admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:13.427180 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-54071e78-4cd7-41bf-b771-3bc073506fdb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 02 09:02:13.427577 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:02:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:13.933767 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-2f475a50-5b01-499a-aeed-6d44313e652b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "id": "4", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:13.967809 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-2f475a50-5b01-499a-aeed-6d44313e652b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.534037 Sep 02 09:02:13.968701 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:02:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:02:13.981111 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-31b78f1f-3355-4618-aefe-6b8be91e9da9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:14.009322 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-31b78f1f-3355-4618-aefe-6b8be91e9da9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032031 Sep 02 09:02:14.011610 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1333 bytes} [Fri Sep 2 09:02:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:02:16.390047 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-2f475a50-5b01-499a-aeed-6d44313e652b admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:16.391045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-2f475a50-5b01-499a-aeed-6d44313e652b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 02 09:02:16.391753 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:16.837506 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-fc2e911c-30bc-44be-95d8-5d67f2610f31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "disk": 160}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:16.856772 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-fc2e911c-30bc-44be-95d8-5d67f2610f31 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458959 Sep 02 09:02:16.857424 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1283 bytes} [Fri Sep 2 09:02:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:02:16.869589 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-a131c55e-7fb0-48d6-8312-4e0694ec9752 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:16.882111 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:02:16.900107 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-a131c55e-7fb0-48d6-8312-4e0694ec9752 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034074 Sep 02 09:02:16.901131 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1333 bytes} [Fri Sep 2 09:02:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:02:35.480376 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-fc2e911c-30bc-44be-95d8-5d67f2610f31 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:35.481425 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-fc2e911c-30bc-44be-95d8-5d67f2610f31 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 02 09:02:35.481836 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:02:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:35.863642 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-0494f185-6f16-45b1-ac9e-d114adc8c75e admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:35.883049 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-0494f185-6f16-45b1-ac9e-d114adc8c75e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.394739 Sep 02 09:02:35.883591 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1292 bytes} [Fri Sep 2 09:02:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:02:36.929729 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-fc2e911c-30bc-44be-95d8-5d67f2610f31 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:36.930732 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-fc2e911c-30bc-44be-95d8-5d67f2610f31 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 02 09:02:36.931156 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:37.444815 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-702bc98c-4aed-4681-a7ad-5fbd526a08f0 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:37.450953 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.wsgi [None req-702bc98c-4aed-4681-a7ad-5fbd526a08f0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-702bc98c-4aed-4681-a7ad-5fbd526a08f0 admin admin] Request method failure captured: Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Accept: application/json Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Accept-Encoding: gzip, deflate Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Connection: keep-alive Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Content-Length: 0 Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Host: 10.222.0.36 Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Openstack-Api-Version: compute 2.92 Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Openstack-System-Scope: None Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: User-Agent: python-novaclient Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Auth-Token: gAAAAABjEcasK-UVR2PJUd13Ts7Euhz8DUMFtR6r4CYgoZi2HLNF4UDZaMzNUy2eMoYp4-VI22CLmNOKsyd94chpYfBC7mVmtFFXYuWopvJK_LkAjocrSuuaujd9RJk-AHVGp15EidX7dB7oxTvR_GXh95OJNsyOogfGoM_bUbofAF4K-sxhBp0 Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Domain-Id: None Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Domain-Name: None Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Identity-Status: Confirmed Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Is-Admin-Project: True Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Id: default Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Name: Default Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Name: admin Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Role: admin,reader,member Sep 02 09:02:37.454184 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Roles: admin,reader,member Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32923700004a4c11b8926f21bae6d460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32923700004a4c11b8926f21bae6d460", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Tenant: admin Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Tenant-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Tenant-Name: admin Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User: admin Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Id: default Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Name: Default Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Id: 95efeb6f9f5f497f9453dc5e9764070a Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Name: admin Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: method: > Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: exception: Flavor 42 could not be found. Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: action_args: {'id': '42'} Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:02:37.455882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:37.456836 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.458319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-702bc98c-4aed-4681-a7ad-5fbd526a08f0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:02:37.459666 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-702bc98c-4aed-4681-a7ad-5fbd526a08f0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387556 Sep 02 09:02:37.459666 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Fri Sep 2 09:02:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:02:37.465304 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-139f1218-b27b-4cf5-a38f-f0c5e4c62114 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:37.469580 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:02:37.491219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-139f1218-b27b-4cf5-a38f-f0c5e4c62114 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029419 Sep 02 09:02:37.491765 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Fri Sep 2 09:02:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:02:37.502143 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-a3392b9e-07dd-4b01-8542-f5ef79884bee admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:37.524379 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-a3392b9e-07dd-4b01-8542-f5ef79884bee admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025771 Sep 02 09:02:37.524924 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Fri Sep 2 09:02:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:02:37.535064 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-6e63abf6-a638-4135-9eb3-a9cc84edafa0 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:37.541464 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.wsgi [None req-6e63abf6-a638-4135-9eb3-a9cc84edafa0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-6e63abf6-a638-4135-9eb3-a9cc84edafa0 admin admin] Request method failure captured: Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Accept: application/json Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Accept-Encoding: gzip, deflate Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Connection: keep-alive Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Content-Length: 0 Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Host: 10.222.0.36 Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Openstack-Api-Version: compute 2.92 Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Openstack-System-Scope: None Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: User-Agent: python-novaclient Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Auth-Token: gAAAAABjEcasK-UVR2PJUd13Ts7Euhz8DUMFtR6r4CYgoZi2HLNF4UDZaMzNUy2eMoYp4-VI22CLmNOKsyd94chpYfBC7mVmtFFXYuWopvJK_LkAjocrSuuaujd9RJk-AHVGp15EidX7dB7oxTvR_GXh95OJNsyOogfGoM_bUbofAF4K-sxhBp0 Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Domain-Id: None Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Domain-Name: None Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Identity-Status: Confirmed Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Is-Admin-Project: True Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Domain-Id: default Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Domain-Name: Default Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Name: admin Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Role: admin,reader,member Sep 02 09:02:37.545219 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Roles: admin,reader,member Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32923700004a4c11b8926f21bae6d460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32923700004a4c11b8926f21bae6d460", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Tenant: admin Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Tenant-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Tenant-Name: admin Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User: admin Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Domain-Id: default Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Domain-Name: Default Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Id: 95efeb6f9f5f497f9453dc5e9764070a Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Name: admin Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: method: > Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: exception: Flavor 42 could not be found. Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: action_args: {'id': '42'} Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:02:37.546758 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:37.547823 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:37.548996 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-6e63abf6-a638-4135-9eb3-a9cc84edafa0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:02:37.550029 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-6e63abf6-a638-4135-9eb3-a9cc84edafa0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016040 Sep 02 09:02:37.550029 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Fri Sep 2 09:02:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:02:38.503501 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-a3392b9e-07dd-4b01-8542-f5ef79884bee admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:38.504505 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-a3392b9e-07dd-4b01-8542-f5ef79884bee admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 02 09:02:38.504896 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:02:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:02:39.020120 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-d8dd1f90-d10f-409d-9a04-efc9c760357e admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:39.025343 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.wsgi [None req-d8dd1f90-d10f-409d-9a04-efc9c760357e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-d8dd1f90-d10f-409d-9a04-efc9c760357e admin admin] Request method failure captured: Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Accept: application/json Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Accept-Encoding: gzip, deflate Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Connection: keep-alive Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Content-Length: 0 Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Host: 10.222.0.36 Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Openstack-Api-Version: compute 2.92 Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Openstack-System-Scope: None Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: User-Agent: python-novaclient Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Auth-Token: gAAAAABjEcau7sLojkZgSDRIlAprKlxkT9lBPiLGU69C2GY0MhUVSkP28EGXucLylX1feOx7iVcDJ9Qo_8oegmB6lGgFk0qRTBl9apGTw7y86btb7dNRjJrW3cCbjkwQYyp6Tif1HaCQEBgcB0bS9JYWkK_ZZcc043ujWAfqG-GeKdHGr6Y6st8 Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Domain-Id: None Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Domain-Name: None Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Identity-Status: Confirmed Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Is-Admin-Project: True Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Domain-Id: default Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Domain-Name: Default Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Name: admin Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Role: admin,reader,member Sep 02 09:02:39.026826 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Roles: admin,reader,member Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32923700004a4c11b8926f21bae6d460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32923700004a4c11b8926f21bae6d460", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Tenant: admin Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Tenant-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Tenant-Name: admin Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User: admin Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Domain-Id: default Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Domain-Name: Default Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Id: 95efeb6f9f5f497f9453dc5e9764070a Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Name: admin Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: method: > Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: exception: Flavor 84 could not be found. Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: action_args: {'id': '84'} Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:02:39.029039 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:39.030192 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.031554 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-d8dd1f90-d10f-409d-9a04-efc9c760357e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:02:39.032828 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-d8dd1f90-d10f-409d-9a04-efc9c760357e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387540 Sep 02 09:02:39.032828 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Fri Sep 2 09:02:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:02:39.038313 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-de8380c9-8772-46ff-b257-57f2330587bf admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:39.053011 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-de8380c9-8772-46ff-b257-57f2330587bf admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018311 Sep 02 09:02:39.053538 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Fri Sep 2 09:02:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:02:39.062558 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-47d63c64-8e78-41ea-aa47-a7370bf651d1 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:39.077928 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-47d63c64-8e78-41ea-aa47-a7370bf651d1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018771 Sep 02 09:02:39.078427 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Fri Sep 2 09:02:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:02:39.087727 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-05c38f6c-84b7-46e4-ac2d-45a475e8ae48 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:39.093558 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.wsgi [None req-05c38f6c-84b7-46e4-ac2d-45a475e8ae48 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-05c38f6c-84b7-46e4-ac2d-45a475e8ae48 admin admin] Request method failure captured: Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Accept: application/json Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Accept-Encoding: gzip, deflate Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Connection: keep-alive Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Content-Length: 0 Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Host: 10.222.0.36 Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Openstack-Api-Version: compute 2.92 Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Openstack-System-Scope: None Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: User-Agent: python-novaclient Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Auth-Token: gAAAAABjEcau7sLojkZgSDRIlAprKlxkT9lBPiLGU69C2GY0MhUVSkP28EGXucLylX1feOx7iVcDJ9Qo_8oegmB6lGgFk0qRTBl9apGTw7y86btb7dNRjJrW3cCbjkwQYyp6Tif1HaCQEBgcB0bS9JYWkK_ZZcc043ujWAfqG-GeKdHGr6Y6st8 Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Domain-Id: None Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Domain-Name: None Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Identity-Status: Confirmed Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Is-Admin-Project: True Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Id: default Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Name: Default Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Name: admin Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Role: admin,reader,member Sep 02 09:02:39.095063 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Roles: admin,reader,member Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32923700004a4c11b8926f21bae6d460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32923700004a4c11b8926f21bae6d460", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Tenant: admin Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Tenant-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Tenant-Name: admin Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User: admin Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Id: default Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Name: Default Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Id: 95efeb6f9f5f497f9453dc5e9764070a Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Name: admin Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: method: > Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: exception: Flavor 84 could not be found. Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: action_args: {'id': '84'} Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:02:39.096636 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:39.098506 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:39.100045 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-05c38f6c-84b7-46e4-ac2d-45a475e8ae48 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:02:39.101311 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-05c38f6c-84b7-46e4-ac2d-45a475e8ae48 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012247 Sep 02 09:02:39.101311 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Fri Sep 2 09:02:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:02:40.059308 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-47d63c64-8e78-41ea-aa47-a7370bf651d1 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:40.060334 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-47d63c64-8e78-41ea-aa47-a7370bf651d1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001999 Sep 02 09:02:40.060727 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:02:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:40.580884 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-0f68c09d-f65e-46fa-9213-c74bcc088f35 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:40.586537 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.wsgi [None req-0f68c09d-f65e-46fa-9213-c74bcc088f35 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-0f68c09d-f65e-46fa-9213-c74bcc088f35 admin admin] Request method failure captured: Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Accept: application/json Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Accept-Encoding: gzip, deflate Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Connection: keep-alive Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Content-Length: 0 Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Host: 10.222.0.36 Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Openstack-Api-Version: compute 2.92 Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Openstack-System-Scope: None Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: User-Agent: python-novaclient Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Auth-Token: gAAAAABjEcavCRdQKe-WF_IbTgFH-GD8enwTLikzF3NiMJ457kjJCYV6mYFTHlSv8UD1hWbi2Qagw-uVddy8taJMwkQt19sl7OPIuAJKM2oXzlpFlOmc6p4mx8XFrUgM0ptLleX6Ur6ts3-iSwOhf_8QAfsxlyNuU_2JANLY3v4xMTciVw-RqFU Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Domain-Id: None Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Domain-Name: None Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Identity-Status: Confirmed Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Is-Admin-Project: True Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Id: default Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Name: Default Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Project-Name: admin Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Role: admin,reader,member Sep 02 09:02:40.588052 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Roles: admin,reader,member Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32923700004a4c11b8926f21bae6d460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32923700004a4c11b8926f21bae6d460", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Tenant: admin Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Tenant-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-Tenant-Name: admin Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User: admin Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Id: default Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Name: Default Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Id: 95efeb6f9f5f497f9453dc5e9764070a Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: X-User-Name: admin Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: method: > Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: exception: Flavor 451 could not be found. Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: action_args: {'id': '451'} Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:02:40.589738 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:40.590668 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.591778 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-0f68c09d-f65e-46fa-9213-c74bcc088f35 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:02:40.592809 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-0f68c09d-f65e-46fa-9213-c74bcc088f35 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390504 Sep 02 09:02:40.592809 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Fri Sep 2 09:02:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:02:40.599239 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-3e317b33-a60f-465d-ae08-74d8696a5a3d admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:40.614596 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-3e317b33-a60f-465d-ae08-74d8696a5a3d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018880 Sep 02 09:02:40.615163 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Fri Sep 2 09:02:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:02:40.625076 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:40.639889 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019024 Sep 02 09:02:40.640416 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Fri Sep 2 09:02:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:02:40.649415 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-d3219ce1-8503-4d54-ad72-8fa7c0bcf42e admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:40.654655 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.wsgi [None req-d3219ce1-8503-4d54-ad72-8fa7c0bcf42e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-d3219ce1-8503-4d54-ad72-8fa7c0bcf42e admin admin] Request method failure captured: Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Accept: application/json Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Accept-Encoding: gzip, deflate Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Connection: keep-alive Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Content-Length: 0 Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Host: 10.222.0.36 Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Openstack-Api-Version: compute 2.92 Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Openstack-System-Scope: None Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: User-Agent: python-novaclient Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Auth-Token: gAAAAABjEcavCRdQKe-WF_IbTgFH-GD8enwTLikzF3NiMJ457kjJCYV6mYFTHlSv8UD1hWbi2Qagw-uVddy8taJMwkQt19sl7OPIuAJKM2oXzlpFlOmc6p4mx8XFrUgM0ptLleX6Ur6ts3-iSwOhf_8QAfsxlyNuU_2JANLY3v4xMTciVw-RqFU Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Domain-Id: None Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Domain-Name: None Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Identity-Status: Confirmed Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Is-Admin-Project: True Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Domain-Id: default Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Domain-Name: Default Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Project-Name: admin Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Role: admin,reader,member Sep 02 09:02:40.656237 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Roles: admin,reader,member Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32923700004a4c11b8926f21bae6d460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32923700004a4c11b8926f21bae6d460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32923700004a4c11b8926f21bae6d460", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Tenant: admin Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Tenant-Id: 32923700004a4c11b8926f21bae6d460 Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-Tenant-Name: admin Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User: admin Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Domain-Id: default Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Domain-Name: Default Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Id: 95efeb6f9f5f497f9453dc5e9764070a Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: X-User-Name: admin Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: method: > Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: exception: Flavor 451 could not be found. Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: action_args: {'id': '451'} Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:02:40.657682 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:40.658525 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: ERROR nova.api.openstack.wsgi Sep 02 09:02:40.659864 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-d3219ce1-8503-4d54-ad72-8fa7c0bcf42e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:02:40.661102 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-d3219ce1-8503-4d54-ad72-8fa7c0bcf42e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011659 Sep 02 09:02:40.661102 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Fri Sep 2 09:02:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:02:41.612390 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:41.613406 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 02 09:02:41.614154 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:42.131567 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-5d884388-65c9-49ff-b08e-7456ade1b1d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:42.150354 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-5d884388-65c9-49ff-b08e-7456ade1b1d8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.396388 Sep 02 09:02:42.150887 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Fri Sep 2 09:02:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:02:43.105878 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:43.106882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 02 09:02:43.107319 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:02:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:43.624213 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-289fa224-5ab9-44a8-93df-5085f4a1dd41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:43.642135 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-289fa224-5ab9-44a8-93df-5085f4a1dd41 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.398803 Sep 02 09:02:43.642675 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Fri Sep 2 09:02:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:02:44.613982 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:44.615054 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 02 09:02:44.615468 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:45.146104 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-a76168ee-8dc6-400a-b11a-a0d319a19bcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:45.165142 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-a76168ee-8dc6-400a-b11a-a0d319a19bcb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.409815 Sep 02 09:02:45.165889 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Fri Sep 2 09:02:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:02:46.125181 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:46.126181 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 02 09:02:46.126570 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:02:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:46.638502 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-30fdf2d3-3893-4f97-ad46-971a1e0d4850 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:02:46.657173 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-30fdf2d3-3893-4f97-ad46-971a1e0d4850 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.395699 Sep 02 09:02:46.657711 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Fri Sep 2 09:02:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:02:47.637219 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:47.638251 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Sep 02 09:02:47.638645 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:02:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:02:48.152667 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-1f46fd59-05f7-49a9-83d3-4ff78d6a7605 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:02:48.173181 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-1f46fd59-05f7-49a9-83d3-4ff78d6a7605 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398285 Sep 02 09:02:48.173768 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Fri Sep 2 09:02:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:03:41.041588 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:03:41.042525 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8102fc7b-7a77-4b08-940b-2aecc8207e08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 02 09:03:41.042929 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 931 bytes} [Fri Sep 2 09:03:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:03:41.057663 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:03:41.432247 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-508f84a6-26cd-4180-8803-55af2a735c63 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:03:41.453643 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-508f84a6-26cd-4180-8803-55af2a735c63 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404413 Sep 02 09:03:41.454169 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1292 bytes} [Fri Sep 2 09:03:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:03:41.474819 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:03:41.478670 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-d19a1c1b-5429-49ba-842e-8c75b1f067c5 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:03:41.487257 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-d19a1c1b-5429-49ba-842e-8c75b1f067c5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013825 Sep 02 09:03:41.487769 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1283 bytes} [Fri Sep 2 09:03:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:03:41.499857 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-5656672c-8fce-4f99-ad77-988a2ab7d1c2 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:03:41.507490 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-5656672c-8fce-4f99-ad77-988a2ab7d1c2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011841 Sep 02 09:03:41.508002 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1286 bytes} [Fri Sep 2 09:03:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:03:41.518962 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:03:41.526911 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011338 Sep 02 09:03:41.527462 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1286 bytes} [Fri Sep 2 09:03:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:03:41.538615 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-a88a4a8a-703f-491c-805c-d32c03679606 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:03:41.546755 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-a88a4a8a-703f-491c-805c-d32c03679606 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011611 Sep 02 09:03:41.547308 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1283 bytes} [Fri Sep 2 09:03:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:06:36.308917 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:06:36.309922 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 02 09:06:36.310313 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:06:36.452267 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_api:SELECT=6 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:06:36.608528 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-fae95394-bc3b-47e9-902e-0f8cbaddc19c admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:06:36.612118 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-fae95394-bc3b-47e9-902e-0f8cbaddc19c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:06:36.612623 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-fae95394-bc3b-47e9-902e-0f8cbaddc19c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:06:36.613048 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-fae95394-bc3b-47e9-902e-0f8cbaddc19c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:06:36.613760 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-fae95394-bc3b-47e9-902e-0f8cbaddc19c admin admin] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:06:36.614203 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-fae95394-bc3b-47e9-902e-0f8cbaddc19c admin admin] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:06:36.614617 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-fae95394-bc3b-47e9-902e-0f8cbaddc19c admin admin] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:06:36.648649 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-fae95394-bc3b-47e9-902e-0f8cbaddc19c admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197862 Sep 02 09:06:36.649208 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Fri Sep 2 09:06:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:06:37.467565 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:06:37.468946 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001823 Sep 02 09:06:37.469341 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:06:37.658524 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-2690d5a2-ca7a-4423-be6d-7a14e965eba0 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:06:37.661982 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-2690d5a2-ca7a-4423-be6d-7a14e965eba0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:06:37.662493 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-2690d5a2-ca7a-4423-be6d-7a14e965eba0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:06:37.662923 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-2690d5a2-ca7a-4423-be6d-7a14e965eba0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:06:37.663673 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-2690d5a2-ca7a-4423-be6d-7a14e965eba0 admin admin] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:06:37.664118 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-2690d5a2-ca7a-4423-be6d-7a14e965eba0 admin admin] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:06:37.664531 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-2690d5a2-ca7a-4423-be6d-7a14e965eba0 admin admin] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:06:37.684789 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-2690d5a2-ca7a-4423-be6d-7a14e965eba0 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077280 Sep 02 09:06:37.685338 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Fri Sep 2 09:06:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:06:48.935887 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:06:48.936882 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 02 09:06:48.937273 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:06:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:06:49.078031 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_cell0:SELECT=4 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:06:49.078806 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_cell1:SELECT=4 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:06:49.079968 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG dbcounter [-] [105596] Writing DB stats nova_api:SELECT=8 {{(pid=105596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:06:49.127164 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-bf79d024-7c65-4d71-a526-1fc24c0cd987 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:06:49.130493 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-bf79d024-7c65-4d71-a526-1fc24c0cd987 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:06:49.130965 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-bf79d024-7c65-4d71-a526-1fc24c0cd987 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:06:49.131418 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-bf79d024-7c65-4d71-a526-1fc24c0cd987 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:06:49.132128 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-bf79d024-7c65-4d71-a526-1fc24c0cd987 admin admin] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:06:49.132568 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-bf79d024-7c65-4d71-a526-1fc24c0cd987 admin admin] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:06:49.132982 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-bf79d024-7c65-4d71-a526-1fc24c0cd987 admin admin] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:06:49.158053 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-bf79d024-7c65-4d71-a526-1fc24c0cd987 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084419 Sep 02 09:06:49.158527 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Fri Sep 2 09:06:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:06:49.992940 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:06:49.993939 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8aab76eb-c7f0-4a79-9454-af85e9147b90 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 02 09:06:49.994337 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Fri Sep 2 09:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:06:50.187640 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG nova.api.openstack.wsgi [None req-1a397b24-9df9-48fd-934f-8cb24ffe5fa6 admin admin] Calling method '>' {{(pid=105596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:06:50.191596 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-1a397b24-9df9-48fd-934f-8cb24ffe5fa6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:06:50.192064 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-1a397b24-9df9-48fd-934f-8cb24ffe5fa6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:06:50.192519 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-1a397b24-9df9-48fd-934f-8cb24ffe5fa6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:06:50.193497 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-1a397b24-9df9-48fd-934f-8cb24ffe5fa6 admin admin] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:06:50.193938 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-1a397b24-9df9-48fd-934f-8cb24ffe5fa6 admin admin] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:06:50.194351 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: DEBUG oslo_concurrency.lockutils [None req-1a397b24-9df9-48fd-934f-8cb24ffe5fa6 admin admin] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:06:50.216599 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: INFO nova.api.openstack.requestlog [None req-1a397b24-9df9-48fd-934f-8cb24ffe5fa6 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080572 Sep 02 09:06:50.217163 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: [pid: 105596|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Fri Sep 2 09:06:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:07:46.148772 dv-cinder-855359-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 02 09:07:46.149349 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: Fri Sep 2 09:07:46 2022 - graceful shutdown triggered... Sep 02 09:07:46.149837 dv-cinder-855359-2-iscsi devstack@n-api.service[105596]: Gracefully killing worker 2 (pid: 105596)... Sep 02 09:07:46.150262 dv-cinder-855359-2-iscsi devstack@n-api.service[105595]: Gracefully killing worker 1 (pid: 105595)... Sep 02 09:07:47.150493 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: worker 1 buried after 1 seconds Sep 02 09:07:47.150953 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: worker 2 buried after 1 seconds Sep 02 09:07:47.150953 dv-cinder-855359-2-iscsi devstack@n-api.service[105594]: goodbye to uWSGI. Sep 02 09:07:47.152067 dv-cinder-855359-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 02 09:07:47.152623 dv-cinder-855359-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 02 09:07:47.155406 dv-cinder-855359-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 09:07:47.165088 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 09:07:47 2022] *** Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: nodename: dv-cinder-855359-2-iscsi Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: machine: x86_64 Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: clock source: unix Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: pcre jit disabled Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: detected number of CPU cores: 4 Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: current working directory: / Sep 02 09:07:47.167112 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: detected binary path: /usr/bin/uwsgi-core Sep 02 09:07:47.167800 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: your processes number limit is 47680 Sep 02 09:07:47.167800 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: your memory page size is 4096 bytes Sep 02 09:07:47.167800 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: detected max file descriptor number: 2048 Sep 02 09:07:47.167800 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: lock engine: pthread robust mutexes Sep 02 09:07:47.167800 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: thunder lock: enabled Sep 02 09:07:47.167800 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 09:07:47.167800 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 09:07:47.207741 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: Python main interpreter initialized at 0x55b8656ff9c0 Sep 02 09:07:47.207741 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: python threads support enabled Sep 02 09:07:47.207741 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: your server socket listen backlog is limited to 100 connections Sep 02 09:07:47.207741 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: your mercy for graceful operations on workers is 90 seconds Sep 02 09:07:47.208198 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 09:07:47.208198 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: *** Operational MODE: preforking *** Sep 02 09:07:47.208449 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: *** uWSGI is running in multiple interpreter mode *** Sep 02 09:07:47.208449 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: spawned uWSGI master process (pid: 120550) Sep 02 09:07:47.208652 dv-cinder-855359-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 09:07:47.209708 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: spawned uWSGI worker 1 (pid: 120572, cores: 1) Sep 02 09:07:47.210066 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: spawned uWSGI worker 2 (pid: 120573, cores: 1) Sep 02 09:07:47.211147 dv-cinder-855359-2-iscsi devstack@n-api.service[120550]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 09:07:47.867142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 09:07:47.870638 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 09:07:49.030116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:07:49.030116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: from cryptography.utils import int_from_bytes Sep 02 09:07:49.030865 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:07:49.030865 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: from cryptography.utils import int_from_bytes Sep 02 09:07:49.030995 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:07:49.030995 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: from cryptography.utils import int_from_bytes Sep 02 09:07:49.031434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:07:49.031434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: from cryptography.utils import int_from_bytes Sep 02 09:07:51.476487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:07:51.477566 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:07:51.478231 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:07:51.478631 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:07:51.478929 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:07:51.479037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:07:51.479429 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:07:51.479691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:07:51.480086 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.480313 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:07:51.480425 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.480730 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.481054 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.481300 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:07:51.481403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.481696 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.482022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.482348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.482617 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.482733 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.482930 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.483328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.483669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-2-iscsi {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.483797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.484151 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.484468 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.484734 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.484836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.485101 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.485412 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.485838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.485980 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.486211 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.486728 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.486931 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.487522 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.488074 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.488619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.489174 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.489291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.489764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.489870 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.490345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.490594 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.490960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.491367 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-2-iscsi {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.491553 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.492071 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.492461 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.492655 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.493145 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.493395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.493509 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.493886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.494258 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.494368 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-2-iscsi {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.494665 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.494993 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.495346 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.495463 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.495945 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.496193 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.496307 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.496580 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.497046 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.497150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.497486 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.497810 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.498082 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.498199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.498562 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.498898 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.499256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.499551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.499669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.499872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.500192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.500522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.500788 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.500903 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.501135 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.501901 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.502229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.502532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.502643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.502876 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.503246 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.503505 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.503761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.504023 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.504223 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.504769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.505090 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.505417 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.505726 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.505829 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.506183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.506505 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.506767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.506870 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.507361 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.507646 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.507773 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.507988 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.508321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.508647 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.508897 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.509009 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.509286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.509614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.509934 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.510037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.510272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.510586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.510937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.511193 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.511296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.511602 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.511930 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.512319 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-2-iscsi {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.512431 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.512730 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.513051 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.513369 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.513486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.513694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.514038 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.514351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.514618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.515260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.515893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.516232 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.519136 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.519288 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.519288 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.519288 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.519554 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.519651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.519739 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.519831 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.519918 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.520018 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.520105 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.520197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.520197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.520197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.520197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.520518 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.520686 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.520951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.521066 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.521296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.521413 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.521552 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.521675 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.521957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.522142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.522300 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.522478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.522611 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.522946 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.523313 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.523544 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.523663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.523953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.524186 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.524305 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.524448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.524597 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.524871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.524984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.525213 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.525315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.525545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.525674 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.525876 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.526152 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.526260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.526476 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.526652 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.526815 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.527133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.527233 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.527456 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.527704 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.527803 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.528076 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.528230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.528390 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.528549 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.528715 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.528885 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.529051 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.529285 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.529394 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.529575 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.529675 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.529909 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.530017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.530231 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.530338 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.530552 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.530659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.530885 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.530992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.531325 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.531418 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.531576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.531679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.531859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.531971 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.532179 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.532334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.532487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.532690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.532913 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.533064 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.533218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.533373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.533524 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.533676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.533826 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.533970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.534113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.534265 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.534424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.534569 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.534729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.534872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.535015 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.535234 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.535396 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.535539 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.535690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.535842 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.535992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.536145 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.536290 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.536433 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.536574 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.536726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.536871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.537028 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.537180 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.537484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.537723 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.537881 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.538036 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.538322 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.538475 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.538626 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.538769 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.538911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.539113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.539281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.539520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.539672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.539823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.539978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.540138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.540298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.540451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.540601 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.540744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.540903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.541065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.541217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.541361 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.541577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.541723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.541874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.542024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.542175 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.542343 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.542497 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.542649 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.542800 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.543035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.543263 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.543428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.543574 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.543718 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.543869 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.544020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.544173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.544327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.544479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.544623 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.544772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.544922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.545066 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.545239 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.545391 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.545535 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.545685 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.545828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.546026 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.546175 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.546317 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.546467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.546611 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.546753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.546753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.547044 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.547242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.547396 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.547559 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.547786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.547943 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.548089 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.548363 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.548525 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.548677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.548837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.548991 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.549143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.549307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.549567 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.549736 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.549881 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.550024 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.550181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.550325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:07:51.550468 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.550610 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.550790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.550943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.551214 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.551373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.551543 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.551687 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.551864 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.552033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.552189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.552339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.552502 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.552645 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.552815 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.552977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.553210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.553359 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.553501 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.553672 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.553815 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.553974 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.554127 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.554280 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.554424 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.554581 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.554740 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.554892 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.555043 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.555294 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.555440 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.555600 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.555753 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.555897 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.556048 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.556204 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.556348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.556491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.556642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.556797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.556941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.557085 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.557228 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.557371 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.557537 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.557908 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.558073 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.558230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.558376 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.558529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.558672 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.558815 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.558957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.559125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.559290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.559457 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.559760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.559945 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.560099 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.560251 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.560403 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.560561 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.560706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.560857 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.561008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.561158 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.561312 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.561463 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.561607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.561750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.561910 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.562055 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.562230 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.562397 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.562558 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.562707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.562858 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.563001 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.563210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.563433 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.563583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.563734 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.564395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.564548 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.564706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.564850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.565002 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.565154 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.565298 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.565442 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.565596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.565748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.565899 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.566050 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.566208 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.566362 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.566519 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.566671 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.566821 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.566965 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.567493 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.567854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.568182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.568495 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.568769 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.568931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.569083 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.569392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.569901 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.570053 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.570294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.570458 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.570619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.570848 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.570995 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.571169 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.571315 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.571468 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.571611 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.571763 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.571916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.572078 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.572222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.572475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.572691 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.572840 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.572982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.573133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.573283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.573453 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.573687 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.573846 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.574011 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.574011 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.574306 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.574449 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.574602 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.574746 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.574888 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.575041 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.575900 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.576053 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.576198 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.576340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.576506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.576660 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.576804 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.576947 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.577098 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.577500 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.577685 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.577841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.577986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.578326 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.578487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.578789 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.578958 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.579139 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.579301 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.579455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.579455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.579455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.580787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581021 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581716 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.581923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.583420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.583420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.583420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.583420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.585447 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.585447 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.585447 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.585447 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.586482 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.586482 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.586787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.586952 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.587163 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.587322 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.587473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.587628 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.587782 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.587940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.588096 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.588246 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.588613 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.588784 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.589026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.589026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.589339 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.589494 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.589647 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.589797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.589947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.590100 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.590250 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.590404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.590663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.590821 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.590984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.591163 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.591163 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.591459 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.591613 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.591759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.591918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.592074 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.592235 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.592390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.592533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.592682 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.592843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.592999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.593166 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.593316 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.593467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.593617 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.593782 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.593877 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.594031 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.594122 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.594359 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.594453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.594809 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.594923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.595314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.595413 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.595502 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.595596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.595749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.595892 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.596073 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.596210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.596390 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.596504 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.596724 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.596819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.597043 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.597142 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.597367 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.597475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.597684 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.597783 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.598017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.598116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.598334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.598436 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.598664 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.598821 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.598978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.599324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.599439 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.599650 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.599743 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.599972 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.600074 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.600289 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.600395 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.600623 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.600748 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.600940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.601051 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.601256 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.601365 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.601576 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.601679 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.601891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.601992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.602202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.602313 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.602514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.602609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.602827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.602935 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.603168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.603291 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.603486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.603595 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.603802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.603912 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.604114 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.604269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.604421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.604570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.604720 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.604859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.605057 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.605196 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.605336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.605482 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.605630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.605774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.605928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.606078 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.606226 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.606375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.606552 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.606699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.606882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.607024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.607221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.607363 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.607532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.607692 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.607845 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.607984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.608160 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.608302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.608469 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.608624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.608783 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.608907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.609109 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.609333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.609447 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.609664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.609766 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.609990 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.610094 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.610329 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.610432 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.610658 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.610782 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.611004 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.611180 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.611353 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.611504 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.611654 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.611809 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.611971 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.612113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.612340 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.612500 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.612640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.612786 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.612926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.613063 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.613202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.613355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.613508 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.613702 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.613858 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.614009 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.614165 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.614311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.614467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.614619 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.614764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.615042 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.615321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.615419 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.615504 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.615686 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.615837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.616046 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.616152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.616373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.616509 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.616723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.616961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.617081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.617410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.617630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.617776 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.618035 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.618355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.618669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.618986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.619445 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.619766 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.619980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.620072 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.620338 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.620437 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.620856 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.621206 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.621565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.622736 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.622914 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623042 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623174 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623503 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623604 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623692 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623789 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.623974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.624097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.624299 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.624397 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.624491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.624576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.624798 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.624909 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.625125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.625295 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.625452 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.625595 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.625733 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.625889 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.626036 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.626182 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.626347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.626991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.627202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.627353 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.627508 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.627632 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.627831 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.627979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.628148 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.628340 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.628481 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.628661 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.628799 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.628980 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.629113 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.629428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.629553 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.629741 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.629858 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.630056 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.630223 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.630377 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.630479 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.630701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.630802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.631022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.631157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.631366 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.631478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.631688 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.631789 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.632011 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.632120 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.632333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.632429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.632646 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.632746 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.632958 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.633061 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.633268 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.633370 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.633581 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.633673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.633892 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.633994 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.634202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.634300 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.634516 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.634618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.634830 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.634933 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.635175 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.635281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.635488 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.635589 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.635802 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.635896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.636117 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.636217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.636428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.636539 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.636749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.636850 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.637061 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.637154 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.637373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.637483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.637684 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.637786 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.638001 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.638101 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.638318 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.638420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.638626 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.638727 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.638945 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.639147 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.639313 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.639507 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.639711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.639866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.640016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.640166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.640321 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.640469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.640615 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.640754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.640910 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.641046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.641203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.641360 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.641495 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.641635 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.641774 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.641912 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.642112 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.642818 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.642958 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.643167 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.643263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.643489 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.643593 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.643807 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.643900 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.644116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.644216 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.644432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.644533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.644745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.644849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.645057 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.645157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.645366 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.645469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.645675 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.645767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.645985 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.646073 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.646298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.646402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.646609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.646701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.646919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.647011 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.647257 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.647353 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.647565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.647663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.647875 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.647972 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.648187 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.648297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.648497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.648598 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.648826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.648929 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.649142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.649242 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.649492 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.649604 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.649763 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.649959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.650067 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.650167 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.650410 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.650509 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.650724 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.650879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.651106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.651264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.651424 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.651578 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.651730 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.651885 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.652060 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.652212 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.652378 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.652521 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.652695 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.652837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.653015 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.653156 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.653328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.653476 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.653649 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.653799 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.653955 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.654095 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.654270 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.654417 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.654565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.654705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.654874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.655015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.655241 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.655402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.655545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.655687 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.655865 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.656016 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.656179 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.656339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.656483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.656662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.656806 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.656899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.657126 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.657229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.657437 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.657529 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.657779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.657882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.658094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.658201 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.658408 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.658506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.658721 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.658813 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.659034 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.659162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.659378 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.659466 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.659698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.659805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.660018 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.660191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.660353 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.660500 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.660645 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.660787 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.660958 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.661107 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.661250 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.661397 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.661565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.661701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.661856 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.662010 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.662161 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.662309 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.662458 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.662613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.662765 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.662915 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.663064 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.663194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.663379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.663519 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.663690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.663844 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.664131 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.664225 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.664447 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.664555 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.664764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.664859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.665076 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.665172 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.665392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.665515 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.665711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.665805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.666035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.666127 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.666356 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.666463 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.666668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.666761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.667002 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.667208 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.667385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.667481 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.667701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.667794 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.668034 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.668134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.668349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.668445 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.668673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.668765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.668990 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.669093 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.669325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.669441 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.669637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.669738 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.669948 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.670150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.670388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.670545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.670688 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.670838 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.670999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.671179 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.671324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.671467 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.671632 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.671785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.671951 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.672071 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.672264 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.672359 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.672628 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.672729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.672963 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.673058 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.673321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.673417 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.673644 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.673746 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.673969 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.674062 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.674284 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.674384 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.674599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.674702 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.674924 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.675016 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.675270 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.675365 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.675602 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.675700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.675935 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.676038 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.676253 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.676353 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.676574 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.676670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.676887 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.676979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.677224 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.677309 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.677554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.677639 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.677876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.677987 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.678207 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.678309 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.678583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.678684 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.678898 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.678998 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.679254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.679363 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.679572 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.679711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.679895 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.680014 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.680283 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.680396 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.680518 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.680621 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.680829 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.680934 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.681138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.681252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.681450 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.681545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.681765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.681866 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.682076 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.682250 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.682395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.682497 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.682711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.682805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.683025 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.683182 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.683360 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.683455 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.683668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.683761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.683996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.684099 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.684303 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.684394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.684613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.684716 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.684926 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.685022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.685250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.685350 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.685575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.685677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.685887 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.686000 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.686215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.686308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.686528 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.686630 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.686838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.686933 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.687175 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.687272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.687486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.687596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.687856 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.687949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.688171 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.688265 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.688498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.688606 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.688836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.689447 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.689689 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.689802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.690003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.690123 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.690341 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.690451 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.690637 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.690732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.690951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.691053 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.691294 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.691390 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.691615 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.691716 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.691931 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.692026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.692241 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.692335 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.692550 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.692642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.692866 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.692968 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.693177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.693280 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.693486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.693580 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.693797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.693891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.694107 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.694215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.694416 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.694788 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.694998 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.695130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.695336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.695449 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.695662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.695772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.695970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.696064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.696298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.696399 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.696610 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.696714 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.696918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.697012 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.697228 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.697329 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.697539 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.697643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.697879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.697979 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.698186 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.698278 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.698516 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.698609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.698827 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.698927 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.699170 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.699267 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.699491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.699594 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.699815 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.699920 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.700130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.700225 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.700475 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.700748 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.700851 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.701019 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.701132 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.701344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.701456 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.701669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.701762 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.701996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.702155 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.702312 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.702461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.702610 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.702751 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.702942 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.703170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.703329 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.703505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.703658 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.703826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.703987 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.704137 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.704292 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.704440 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.705158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.705302 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.705445 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.705613 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.705772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.705929 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.706073 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.706237 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.706395 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.706554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.706719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.706871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.707042 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.707229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.707433 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.707563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.707760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.707896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.708076 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.708235 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.708398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.708558 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.708722 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.708877 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.709046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.709196 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.709367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.709516 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.709692 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.709879 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.710019 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.710197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.710342 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.710510 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.710664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.710911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.711013 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.711145 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.711320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.711472 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.711643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.711789 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.711978 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.712094 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.712325 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.712430 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.712651 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.712752 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.712974 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.713070 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.713297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.713390 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.713620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.713712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.713937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.714155 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.714260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.714484 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.714586 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.714832 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.714933 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.715195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.715304 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.715535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.715627 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.715855 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.715960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.716183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.716379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.716524 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.716699 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.716842 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.717038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.717158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.717366 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.717480 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.717703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.717809 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.718026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.718126 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.718349 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.718442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.718681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.718783 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.718994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.719114 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.719474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.719921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.720016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.720109 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.720292 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.720392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.720479 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.720587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.720730 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.721039 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.721157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.721253 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.721568 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.721668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.721903 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.722057 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.722216 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.722499 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.722610 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.722849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.723188 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.723296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.723518 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.723719 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.723855 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.724215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.724759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.724901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.725031 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.725158 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.725287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.725434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.725574 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.725703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.725827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.725827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.726083 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.726229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.726357 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.726357 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.726659 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.726659 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.726917 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.727120 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.727273 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.727442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.727632 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.727818 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.728015 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.728190 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.728339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.728507 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.728661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.728820 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.728995 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.729143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.729244 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.729329 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.729421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.729506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.729605 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.729737 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.729903 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.730221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.730321 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.730582 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.730846 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.730994 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.731336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.731523 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.731672 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.731939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.732092 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.732288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.732486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.732673 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.732805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.732914 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.733002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.733237 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.733332 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.733558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.733659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.733875 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.733980 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.734198 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.734299 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.734514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.734614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.734835 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.735127 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.735226 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.735460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.735630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.735820 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.735985 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.736168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.736320 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.736508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.736637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.736823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.736953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.737138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.737279 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.737451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.737606 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.737787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.737943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.738105 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.738266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.738423 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.738587 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.738739 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.738943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.739056 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.739328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.739435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.739702 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.739869 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.740049 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.740215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.740316 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.740548 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.740656 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.740891 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.740988 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.741336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.741444 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.741531 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.741614 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.741844 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.741938 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.742155 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.742247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.742474 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.742574 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.742794 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.742894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.743134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.743231 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.743453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.743549 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.743771 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.743863 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.744088 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.744189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.744404 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.744498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.744719 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.744819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.745033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.745125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.745346 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.745438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.745659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.745764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.745974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.746077 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.746288 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.746388 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.746600 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.746709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.746911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.747013 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.747255 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.747349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.747606 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.747701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.747933 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.748036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.748256 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.748350 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.748577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.748670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.748915 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.749024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.749211 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.749303 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.749526 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.749626 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.749843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.749944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.750157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.750257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.750477 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.750570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.750811 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.750906 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.751154 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.751263 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.752102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.752229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.752384 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.752484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.752700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.752797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.753019 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.753123 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.753348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.753440 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.753666 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.753764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.754048 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.754158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.754311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.754448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.754627 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.754736 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.754941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.755046 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.755280 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.755377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.755593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.755700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.755905 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.756002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.756220 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.756323 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.756535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.756698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.756856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.757006 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.757146 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.757295 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.757443 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.757652 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.757804 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.757953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.758101 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.758244 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.758390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.758540 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.758680 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.758818 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.758972 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.759143 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.759292 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.759446 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.759594 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.759752 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.759898 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.760044 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.760189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.760341 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.760504 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.760604 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.760817 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.760912 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.761125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.761226 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.761434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.761537 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.761742 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.761842 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.762064 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.762297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.762401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.762488 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.762657 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.762749 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.762972 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.763094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.763308 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.763402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.763620 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.763714 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.763929 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.764020 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.764242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.764344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.764552 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.764662 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.764884 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.764979 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.765203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.765303 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.765524 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.765637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.765848 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.765940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.766162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.766254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.766477 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.766580 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.766792 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.766892 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.767677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.767780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.768007 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.768113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.768333 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.768427 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.768650 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.768741 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.768990 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.769091 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.769307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.769399 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.769622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.769721 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.769938 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.770038 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.770255 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.770348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.770571 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.770662 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.770886 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.770988 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.771203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.771309 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.771523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.771629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.771876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.772065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.772193 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.772438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.772545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.772638 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.772829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.772980 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.773260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.773405 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.773498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.773617 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.773792 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.773927 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.774090 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.774369 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.774690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.774835 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.774939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.775028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.775149 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.775343 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.775454 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.775668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.775785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.775980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.776078 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.776299 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.776414 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.776594 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:07:51.776691 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.776976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.777308 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.777640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.777958 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.778298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.778629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.778982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.779336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.779686 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.780020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.780340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.780657 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.780964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:07:51.781210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:07:51.839333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Registered counter for database nova_api Sep 02 09:07:51.843352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Registered counter for database nova_api Sep 02 09:07:51.860338 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:07:51.862827 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:07:51.867047 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:07:51.869433 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:07:51.924098 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.context [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77b482fe-72b8-4cea-95b2-9e3933054e02(cell1) {{(pid=120572) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 09:07:51.926982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.context [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77b482fe-72b8-4cea-95b2-9e3933054e02(cell1) {{(pid=120573) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 09:07:51.928142 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:07:51.928623 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:07:51.930222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:07:51.930955 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:07:51.931062 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:07:51.931434 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:07:51.931542 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:07:51.933027 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:07:51.933468 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:07:51.933759 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:07:51.934210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:07:51.935478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Registered counter for database nova_cell0 Sep 02 09:07:51.936257 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:07:51.938222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Registered counter for database nova_cell0 Sep 02 09:07:51.940160 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Registered counter for database nova_cell1 Sep 02 09:07:51.942681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Registered counter for database nova_cell1 Sep 02 09:07:51.947875 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:07:51.950074 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:07:51.951735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:07:51.954876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:07:51.955979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:07:51.957301 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:07:51.958264 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:07:52.098637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:07:52.106517 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Registered counter for database nova_cell0 Sep 02 09:07:52.108523 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Registered counter for database nova_cell0 Sep 02 09:07:52.113919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:07:52.115827 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:07:52.118625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:07:52.120401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:07:52.438134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:07:52.440769 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:07:52.448052 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:07:52.449857 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:07:52.796065 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:07:52.800375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:07:52.802017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-dbeddbed-f7d2-4a2c-97af-ee0e62a34552 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:07:52.806409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-77619148-2477-4513-8cf7-753e0cd839ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:07:52.807446 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8656ff9c0 pid: 120573 (default app) Sep 02 09:07:52.812342 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8656ff9c0 pid: 120572 (default app) Sep 02 09:08:28.342103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:08:28.342103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:08:28.342713 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:08:28.343251 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:08:29.728049 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-20218e53-d2c1-4ca7-b39d-c7303325bb0e tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd4f6280>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:29.788697 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:08:29.792435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:08:29.793322 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:08:29.794065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:08:29.835189 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-498d758e-8235-4f6f-82fe-1b103778b723 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] Action: 'create', calling method: .version_select at 0x7f54bd44b700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-505275203", "metadata": {"Type": "work"}}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:08:30.337226 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-20218e53-d2c1-4ca7-b39d-c7303325bb0e tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c5ab934a-b51d-4d25-9ab6-518a2e192891" status: 200 len: 351 microversion: 2.1 time: 1.121706 Sep 02 09:08:30.338791 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1/1] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:08:29 2022] GET /compute/v2.1/os-volumes/c5ab934a-b51d-4d25-9ab6-518a2e192891 => generated 351 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:08:31.138326 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-498d758e-8235-4f6f-82fe-1b103778b723 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.807758 Sep 02 09:08:31.148359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1156 bytes} [Fri Sep 2 09:08:28 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2810 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 09:08:31.162790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6f540066-5e16-40fa-bc98-91c7fa90e766 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] Calling method '.version_select at 0x7f54bd350550>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:31.259913 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6f540066-5e16-40fa-bc98-91c7fa90e766 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48" status: 200 len: 352 microversion: 2.1 time: 0.109184 Sep 02 09:08:31.262461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:08:31 2022] GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:32.277282 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b904d177-cefd-4431-8d6c-917fbf262a96 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] Calling method '.version_select at 0x7f54bd31e550>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:32.361750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1412272b-fca9-4e61-a2a4-cb52b0e32f95 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd350700>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:32.438334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b904d177-cefd-4431-8d6c-917fbf262a96 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48" status: 200 len: 353 microversion: 2.1 time: 0.161042 Sep 02 09:08:32.439538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:08:32 2022] GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:32.452666 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1412272b-fca9-4e61-a2a4-cb52b0e32f95 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e35bc0c1-54e5-4848-bef5-dac65f5c942c" status: 200 len: 351 microversion: 2.1 time: 0.107347 Sep 02 09:08:32.453711 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:08:32 2022] GET /compute/v2.1/os-volumes/e35bc0c1-54e5-4848-bef5-dac65f5c942c => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:32.460639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22e63248-9442-46a1-9bbd-92adb20df2d0 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] Calling method '.version_select at 0x7f54bd31ec10>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:32.562297 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-22e63248-9442-46a1-9bbd-92adb20df2d0 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48" status: 200 len: 353 microversion: 2.1 time: 0.106167 Sep 02 09:08:32.563273 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:08:32 2022] GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:08:32.583243 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dfaaa100-7103-43d7-8b56-a4d55d0ed36c tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] Calling method '.version_select at 0x7f54bd350ca0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:32.731831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dfaaa100-7103-43d7-8b56-a4d55d0ed36c tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48" status: 202 len: 0 microversion: 2.1 time: 0.153373 Sep 02 09:08:32.735496 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:08:32 2022] DELETE /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:08:32.749604 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a9fc48b8-78d5-4f08-b3ed-d970e988d163 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] Calling method '.version_select at 0x7f54bd330310>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:32.869828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a9fc48b8-78d5-4f08-b3ed-d970e988d163 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48" status: 200 len: 352 microversion: 2.1 time: 0.129860 Sep 02 09:08:32.871414 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:08:32 2022] GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:33.886440 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c56e0297-7aa0-41ec-81fe-a7959bc15562 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] Calling method '.version_select at 0x7f54bd31d4c0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:33.933816 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-c56e0297-7aa0-41ec-81fe-a7959bc15562 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] HTTP exception thrown: Volume 85cda641-54f2-405b-9a7d-9b89b1544c48 could not be found. Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c56e0297-7aa0-41ec-81fe-a7959bc15562 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] Request method failure captured: Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48 HTTP/1.1 Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgMEO_6SLsuXlFzlhEkdbDtsJ3jGuZRCCoCH5x_CiZLFe8GKHbPY2Nl410hJ-yfCHnkIhkWfPbF0AS1esOiJX6ymlDfEKjVXMY9CZlyDHd7zcau2x8H3FhwpWGgNuylAdQeuKSaQOXcq3lpji_g8euk6tvW3Sprr1HkzyvFciOwmPY Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 6499e3f183d4412783693d05bd96c76d Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesGetTestJSON-1101781120 Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:08:33.938157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6499e3f183d4412783693d05bd96c76d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6499e3f183d4412783693d05bd96c76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6499e3f183d4412783693d05bd96c76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6499e3f183d4412783693d05bd96c76d", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesGetTestJSON-1101781120 Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 6499e3f183d4412783693d05bd96c76d Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesGetTestJSON-1101781120 Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesGetTestJSON-1101781120-project Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 24be3210cc564b869eaa76567ff83c63 Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesGetTestJSON-1101781120-project Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Volume 85cda641-54f2-405b-9a7d-9b89b1544c48 could not be found. Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '85cda641-54f2-405b-9a7d-9b89b1544c48'} Sep 02 09:08:33.939501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85cda641-54f2-405b-9a7d-9b89b1544c48 could not be found. (HTTP 404) (Request-ID: req-91138abd-530f-43fb-bd19-a8891dbcf4c8) Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:08:33.940218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:08:33.941264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85cda641-54f2-405b-9a7d-9b89b1544c48 could not be found. Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 09:08:33.942398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85cda641-54f2-405b-9a7d-9b89b1544c48 could not be found. Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85cda641-54f2-405b-9a7d-9b89b1544c48 could not be found. Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c56e0297-7aa0-41ec-81fe-a7959bc15562 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] Returning 404 to user: Volume 85cda641-54f2-405b-9a7d-9b89b1544c48 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:08:33.943389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c56e0297-7aa0-41ec-81fe-a7959bc15562 tempest-VolumesGetTestJSON-1101781120 tempest-VolumesGetTestJSON-1101781120-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48" status: 404 len: 109 microversion: 2.1 time: 0.059198 Sep 02 09:08:33.944192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 5/9] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:08:33 2022] GET /compute/v2.1/os-volumes/85cda641-54f2-405b-9a7d-9b89b1544c48 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:08:34.190023 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e2407057-0c8e-4a58-bb7b-44940ebe8c41 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd31edc0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:34.268281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e2407057-0c8e-4a58-bb7b-44940ebe8c41 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ccc9c0d8-f858-40ec-882b-fe9708ccc9bc" status: 200 len: 351 microversion: 2.1 time: 0.082635 Sep 02 09:08:34.269506 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 5/10] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:08:34 2022] GET /compute/v2.1/os-volumes/ccc9c0d8-f858-40ec-882b-fe9708ccc9bc => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:34.285113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55a3cb2f-84e0-4c79-b209-4afe7d5262d4 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd31ddc0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:34.502370 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-55a3cb2f-84e0-4c79-b209-4afe7d5262d4 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.223281 Sep 02 09:08:34.502942 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1134 bytes} [Fri Sep 2 09:08:34 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:34.517998 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-622d7fe2-3e10-454b-acbd-15c59b2bfbd2 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd31e700>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:34.740897 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-622d7fe2-3e10-454b-acbd-15c59b2bfbd2 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.227111 Sep 02 09:08:34.741735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1149 bytes} [Fri Sep 2 09:08:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:34.757003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c643b62d-3662-43c6-b9fb-135d8b5a115c tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd281ca0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:34.948499 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c643b62d-3662-43c6-b9fb-135d8b5a115c tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.197018 Sep 02 09:08:34.957372 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1134 bytes} [Fri Sep 2 09:08:34 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:34.962616 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-509986e3-c722-4804-a75d-aad6cc4aa3b0 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd330dc0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:35.105190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-509986e3-c722-4804-a75d-aad6cc4aa3b0 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.146374 Sep 02 09:08:35.106032 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 7/14] 10.222.0.36 () {58 vars in 1167 bytes} [Fri Sep 2 09:08:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:35.118911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d8d84aaa-c30c-44bf-8bac-cfac8b59d8b6 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd299ee0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:35.258568 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d8d84aaa-c30c-44bf-8bac-cfac8b59d8b6 tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.143299 Sep 02 09:08:35.259456 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1170 bytes} [Fri Sep 2 09:08:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:35.273610 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9b09e447-aa1f-4dd9-96bb-936063ad82ff tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd31e8b0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:35.492108 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9b09e447-aa1f-4dd9-96bb-936063ad82ff tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.222436 Sep 02 09:08:35.493452 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1155 bytes} [Fri Sep 2 09:08:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:35.509227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0f0eb3ca-b5a9-4b46-8504-a9f1342181db tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd281dc0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:35.703772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0f0eb3ca-b5a9-4b46-8504-a9f1342181db tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.200508 Sep 02 09:08:35.705374 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 9/17] 10.222.0.36 () {58 vars in 1188 bytes} [Fri Sep 2 09:08:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:35.723284 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8800218e-2a7f-4cff-a97d-bfe59961646a tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] Calling method '.version_select at 0x7f54bd3303a0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:35.923562 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8800218e-2a7f-4cff-a97d-bfe59961646a tempest-VolumesTestJSON-1388532613 tempest-VolumesTestJSON-1388532613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.206483 Sep 02 09:08:35.924932 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1155 bytes} [Fri Sep 2 09:08:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:45.590387 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1562356380", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:08:45.808298 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] validate_networks() for [('e97c2add-51c7-4c3b-b8b8-fa1c6867698c', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:08:47.674652 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18247b94-4b27-4721-a7d0-691a478f25eb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'create', calling method: .version_select at 0x7f54bd2b9c10>, body: {"keypair": {"name": "tempest-keypair-839942582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrAcITcQ6ndQmeneE2w98KpYCs353tIX2vhvTJfcvSW9TZphSemXFUj0MwxDzC4449rubCYhVi1p6Gr6obTBS02TSUpAAvitRR1SvJ/DSPniR9bbFuvG+QSdJU0E9g/8A=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:08:47.844831 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-18247b94-4b27-4721-a7d0-691a478f25eb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Getting quotas for project e03f09713c2e45d9a261416a5dbd0883. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:08:47.864949 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-18247b94-4b27-4721-a7d0-691a478f25eb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Getting quotas for user 10fcb673c54e484a88a0dabe7b8edb15 and project e03f09713c2e45d9a261416a5dbd0883. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:08:47.995225 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18247b94-4b27-4721-a7d0-691a478f25eb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.914535 Sep 02 09:08:47.997066 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 10/19] 10.222.0.36 () {62 vars in 1200 bytes} [Fri Sep 2 09:08:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 918 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 02 09:08:48.115227 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1956605767", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "networks": [{"uuid": "d8f4ca3a-18d5-4ebe-9bb1-0dd5390918d9"}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:08:48.270414 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] validate_networks() for [('d8f4ca3a-18d5-4ebe-9bb1-0dd5390918d9', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:08:49.529173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:08:49.529612 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:08:49.529979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:08:49.530396 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:08:49.530818 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:08:49.578439 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:49.578933 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:49.586183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:49.587199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:49.587836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:49.588273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:49.711850 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Getting quotas for project 6fde620889f34b04bb7c9fcd5ad0a368. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:08:49.739184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Getting quotas for user bf58157cbc8e49c5bd913c68ff859bfb and project 6fde620889f34b04bb7c9fcd5ad0a368. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:08:49.760411 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:08:49.763319 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:08:49.937109 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-907df680-4f3d-49a0-a9fa-7baa59850889 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.892449 Sep 02 09:08:49.944434 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:08:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 4894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:08:50.488529 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b533521c-aae3-40d5-9eb3-0fccdd2537a2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'create', calling method: .version_select at 0x7f54bc98cca0>, body: {"keypair": {"name": "tempest-keypair-1759316574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFznUo40iS6bl0wbA+grfybNOLKew6yegGu1c/N24QP0ZkDBVZMQKD3DqVj01IPmUBssMlUixuG63qeP0b0Ik6rKmOEb8Q8fjm02zMSbakNafrY59OKL5jSWEtdroVCPpQ=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:08:50.556641 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-b533521c-aae3-40d5-9eb3-0fccdd2537a2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Getting quotas for project 2d6a6fe5db0a452a83dde4aac26b0161. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:08:50.566244 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-b533521c-aae3-40d5-9eb3-0fccdd2537a2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Getting quotas for user 4210f948dc7e4a5bac61d10eb6a62eee and project 2d6a6fe5db0a452a83dde4aac26b0161. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:08:50.644870 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b533521c-aae3-40d5-9eb3-0fccdd2537a2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.705320 Sep 02 09:08:50.645957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 11/21] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:08:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:50.650802 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e43efbd4-6a0b-47c0-87d2-9c1445296cd2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:50.655183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e43efbd4-6a0b-47c0-87d2-9c1445296cd2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:50.849889 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e43efbd4-6a0b-47c0-87d2-9c1445296cd2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:50.888781 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e43efbd4-6a0b-47c0-87d2-9c1445296cd2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1222 microversion: 2.1 time: 0.239627 Sep 02 09:08:50.890324 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 12/22] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:50 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1222 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:51.215841 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1426306349", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:08:51.348126 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] validate_networks() for [('e97c2add-51c7-4c3b-b8b8-fa1c6867698c', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:08:51.469689 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:08:51.470184 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:08:51.470611 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:08:51.471635 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:08:51.472275 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:08:51.502632 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:51.503257 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:51.504876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:51.507326 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:51.507991 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:51.508587 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:51.622386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Getting quotas for project 8ebe6b70a4374511b388d20265e4ccdf. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:08:51.644231 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Getting quotas for user 3adaaf8d979d4cf28456812f9dcfa809 and project 8ebe6b70a4374511b388d20265e4ccdf. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:08:51.719196 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:08:51.753566 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:08:52.043658 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4b69731b-f20f-4991-a8df-35a26de9ab87 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.042031 Sep 02 09:08:52.044667 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 11/23] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:08:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:08:52.061458 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c2df7264-0dc2-4809-8fe6-deb766626481 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:52.066286 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c2df7264-0dc2-4809-8fe6-deb766626481 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:52.458267 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c2df7264-0dc2-4809-8fe6-deb766626481 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:52.491766 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c2df7264-0dc2-4809-8fe6-deb766626481 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1215 microversion: 2.1 time: 0.438054 Sep 02 09:08:52.520804 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:52 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1215 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:08:52.688128 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aaf9e282-2703-4e3b-bbd5-9e017528cfe8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: .version_select at 0x7f54bc9750d0>, body: {"keypair": {"name": "tempest-keypair-737700974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQGXF9KfIHlqER1EueREl/OcLLiJV+FMsY8kh+O5uiJneeRzCMNccVoNTN7/2Fjt28wHhNZOZlkCyR7u5EbWsFAUgzLD9J5h8q532SDU9qaEaVF98U4aWjAi7jCyJj3gA=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:08:52.747641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-aaf9e282-2703-4e3b-bbd5-9e017528cfe8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:08:52.782623 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-aaf9e282-2703-4e3b-bbd5-9e017528cfe8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for user e8b5ce2249a84c01ab57c03b656b2949 and project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:08:52.848063 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aaf9e282-2703-4e3b-bbd5-9e017528cfe8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.325786 Sep 02 09:08:52.848677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 13/25] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:08:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:08:53.528233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22b3b85b-a35b-4fc1-b4fc-cfb4bd7bf73a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:53.529521 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-22b3b85b-a35b-4fc1-b4fc-cfb4bd7bf73a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:53.829597 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-22b3b85b-a35b-4fc1-b4fc-cfb4bd7bf73a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:53.838464 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-22b3b85b-a35b-4fc1-b4fc-cfb4bd7bf73a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1215 microversion: 2.1 time: 0.318565 Sep 02 09:08:53.862349 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 14/26] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:53 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1215 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:08:54.272161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:08:54.273199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:08:54.273904 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:08:54.274532 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:08:54.275197 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:08:54.290943 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:54.295576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:54.296375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:54.297397 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:54.298187 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:54.299514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:54.361741 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Getting quotas for project 6fde620889f34b04bb7c9fcd5ad0a368. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:08:54.367223 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Getting quotas for user bf58157cbc8e49c5bd913c68ff859bfb and project 6fde620889f34b04bb7c9fcd5ad0a368. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:08:54.385687 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:08:54.388083 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:08:54.514799 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0bb71eec-b9fe-407c-81cf-d1afe13af860 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.291541 Sep 02 09:08:54.526779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d26dcf96-9b1d-4993-9cef-69a26b5633a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:54.527408 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d26dcf96-9b1d-4993-9cef-69a26b5633a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:54.532753 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 13/27] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:08:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:08:54.877981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:54.879194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:54.894973 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:54.895899 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:54.896649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:54.897554 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:54.898248 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:54.898882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:55.197933 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d26dcf96-9b1d-4993-9cef-69a26b5633a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:55.209940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d26dcf96-9b1d-4993-9cef-69a26b5633a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1222 microversion: 2.1 time: 0.687232 Sep 02 09:08:55.218305 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 15/28] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:54 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1222 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:55.768684 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:55.797059 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-806e47d8-0c1a-4fc5-8627-1f12b3b05f1d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1267 microversion: 2.1 time: 0.938172 Sep 02 09:08:55.800159 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 14/29] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:54 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1267 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:56.241768 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:56.243761 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:56.277509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:56.284641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:56.287546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:56.291455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:56.292103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:56.298450 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:56.833403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:56.834148 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:56.857266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:56.857852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:56.858425 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:56.859323 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:56.859805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:56.860242 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:56.947708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:56.975497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c4f03c47-7f8f-49eb-8240-4eb643d6886d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1274 microversion: 2.1 time: 0.743815 Sep 02 09:08:56.977245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 16/30] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:56 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1274 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:57.221902 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:57.239424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bccf10e6-5869-46e0-9673-98295bd7a01c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1273 microversion: 2.1 time: 0.410939 Sep 02 09:08:57.244532 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 15/31] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:56 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1273 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:57.998540 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:57.999184 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:58.019629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:58.020150 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:58.020650 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:58.029634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:58.030361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:58.031273 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:58.270936 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:58.272833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:58.291836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:58.294649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:58.296932 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:58.301126 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:58.305168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:58.307688 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:58.332532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:58.340861 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f0cec260-dc2e-43f5-94e2-c7bdcdc00e59 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1280 microversion: 2.1 time: 0.345998 Sep 02 09:08:58.363804 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 17/32] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:57 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1280 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:58.896420 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:58.907606 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b9cb12f-1539-473f-8dd7-a7c755621fd8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1273 microversion: 2.1 time: 0.644602 Sep 02 09:08:58.913939 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 16/33] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:58 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1273 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:08:59.361994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:59.363703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:59.374913 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:59.377990 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:59.378731 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:59.381363 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:59.382588 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:59.384715 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:59.892764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:08:59.907011 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b94b7f3e-e96b-4b22-9f30-1bd756ea1f07 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1280 microversion: 2.1 time: 0.549026 Sep 02 09:08:59.937912 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:08:59.938736 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:08:59.944909 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 18/34] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:59 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1280 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:08:59.954018 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:59.954650 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:59.955117 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:08:59.957217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:08:59.959325 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:08:59.961944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:00.031357 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1308448575", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "013e8f98-3f98-448f-a0f7-ca7e9e19c67d"}], "security_groups": [{"name": "tempest-securitygroup--1984542715"}], "key_name": "tempest-keypair-839942582", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:00.701879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:00.718667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d858c4b4-ae39-4e78-b905-bf22fff62c08 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1273 microversion: 2.1 time: 0.786201 Sep 02 09:09:00.731628 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 17/35] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:08:59 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1273 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:00.905602 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] validate_networks() for [('013e8f98-3f98-448f-a0f7-ca7e9e19c67d', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:09:00.929764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:00.930796 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:00.942539 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:00.948660 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:00.951106 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:00.959254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:00.963135 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:00.963837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:01.579135 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:02.258446 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:02.288234 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b79080b4-fa37-4f5f-934a-018c69ebdfbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1280 microversion: 2.1 time: 1.362639 Sep 02 09:09:02.289562 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 18/36] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:00 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1280 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:02.297408 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-820158831", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0e88d96-5a33-4925-b573-ee1c7dbbf348"}], "security_groups": [{"name": "tempest-securitygroup--691184412"}], "key_name": "tempest-keypair-1759316574", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:02.775882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] validate_networks() for [('f0e88d96-5a33-4925-b573-ee1c7dbbf348', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:09:04.330479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:04.381176 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=18 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:05.203735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=20 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:05.627664 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:09:05.630525 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:09:05.635432 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:09:05.637893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:09:05.638760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:09:05.668484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:05.669796 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:05.670987 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:05.672136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:05.674741 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:05.676025 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:05.755813 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Getting quotas for project e03f09713c2e45d9a261416a5dbd0883. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:09:05.785986 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Getting quotas for user 10fcb673c54e484a88a0dabe7b8edb15 and project e03f09713c2e45d9a261416a5dbd0883. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:09:05.861552 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:09:05.872442 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:09:06.091308 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25e2567a-52c7-4405-8ed6-a5a26e185cb1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.060811 Sep 02 09:09:06.103605 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 19/37] 10.222.0.36 () {62 vars in 1188 bytes} [Fri Sep 2 09:09:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 6072 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 02 09:09:06.120379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:06.121783 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:06.152889 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:06.159437 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:06.159943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:06.160697 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:06.166481 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:06.169469 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:08.005607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:09:08.006501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:09:08.007744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:09:08.007953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:09:08.008678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:09:08.013363 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:08.022328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c724321d-f84e-4507-be17-8e29f34db09e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 1.922706 Sep 02 09:09:08.039123 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 20/38] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:06 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:08.059851 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:08.063770 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:08.065651 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:08.066192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:08.071269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:08.079940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:08.080424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:08.087278 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:08.101671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:08.102467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:08.103263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:08.104360 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:08.113264 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:08.114204 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:08.182585 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Getting quotas for project 2d6a6fe5db0a452a83dde4aac26b0161. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:09:08.200558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Getting quotas for user 4210f948dc7e4a5bac61d10eb6a62eee and project 2d6a6fe5db0a452a83dde4aac26b0161. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:09:08.273092 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:09:08.289746 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:09:08.527759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5a153c0b-95a8-42c5-9fdd-68a723f990e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.236549 Sep 02 09:09:08.533239 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:09:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 6243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:09:09.173192 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:09.184993 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-039f81e9-46e4-4b61-8340-eafb90122603 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 1.142760 Sep 02 09:09:09.188886 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 21/40] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:08 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:09.211339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:09.213000 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:09.239552 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:09.241758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:09.242314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:09.244550 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:09.246862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:09.249874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:09.405958 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-d0d7320c-47ba-4d8a-9350-a05741532d4a req-b567ae01-fea0-4e92-9997-2657c185098b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d56b84b-6132-4d68-8ead-b4a14070a060", "tag": "6063817b-61b3-404e-b9c1-6afc180fee12"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:09.451033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d0d7320c-47ba-4d8a-9350-a05741532d4a req-b567ae01-fea0-4e92-9997-2657c185098b service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:09.460833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d0d7320c-47ba-4d8a-9350-a05741532d4a req-b567ae01-fea0-4e92-9997-2657c185098b service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:09.465986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d0d7320c-47ba-4d8a-9350-a05741532d4a req-b567ae01-fea0-4e92-9997-2657c185098b service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:09.551972 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-d0d7320c-47ba-4d8a-9350-a05741532d4a req-b567ae01-fea0-4e92-9997-2657c185098b service nova] Creating event network-changed:6063817b-61b3-404e-b9c1-6afc180fee12 for instance 5d56b84b-6132-4d68-8ead-b4a14070a060 on hv-cinder-85535 Sep 02 09:09:09.553359 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d0d7320c-47ba-4d8a-9350-a05741532d4a req-b567ae01-fea0-4e92-9997-2657c185098b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120572) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 09:09:09.559375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d0d7320c-47ba-4d8a-9350-a05741532d4a req-b567ae01-fea0-4e92-9997-2657c185098b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120572) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 09:09:09.561954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-966976f1-3f3d-4593-83eb-b9d1e2b30ec8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:09.562465 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-966976f1-3f3d-4593-83eb-b9d1e2b30ec8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:09.562884 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-966976f1-3f3d-4593-83eb-b9d1e2b30ec8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:09.572965 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-966976f1-3f3d-4593-83eb-b9d1e2b30ec8 None None] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:09.575767 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-966976f1-3f3d-4593-83eb-b9d1e2b30ec8 None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:09.596444 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-966976f1-3f3d-4593-83eb-b9d1e2b30ec8 None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:09.659192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.compute.rpcapi [None req-966976f1-3f3d-4593-83eb-b9d1e2b30ec8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 09:09:09.669873 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-966976f1-3f3d-4593-83eb-b9d1e2b30ec8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120572) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 09:09:09.692173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:09.742323 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-966976f1-3f3d-4593-83eb-b9d1e2b30ec8 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.201762 Sep 02 09:09:09.746215 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 20/41] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:09.764820 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:09.774454 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-810939042", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "426b5f66-dceb-4940-aa95-179f2d5137c7"}], "security_groups": [{"name": "tempest-securitygroup--626068082"}], "key_name": "tempest-keypair-737700974", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:09.789899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:09.799122 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7afe26fd-76b3-43b3-9be5-976ee6aeef69 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1351 microversion: 2.20 time: 0.606799 Sep 02 09:09:09.843101 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:09 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1351 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:09.878059 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5a79045b-b129-45c6-bfc7-90d7d83d7567 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:09.880958 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5a79045b-b129-45c6-bfc7-90d7d83d7567 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:10.580799 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5a79045b-b129-45c6-bfc7-90d7d83d7567 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:10.596201 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5a79045b-b129-45c6-bfc7-90d7d83d7567 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1237 microversion: 2.1 time: 0.748487 Sep 02 09:09:10.608581 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 23/43] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:09 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1237 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:10.621737 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:10.623180 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:10.634957 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:10.635988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:10.639620 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:10.640779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:10.641622 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:10.643445 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:11.171209 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] validate_networks() for [('426b5f66-dceb-4940-aa95-179f2d5137c7', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:09:11.454922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:11.464110 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-efee29a7-7601-4edb-9f56-575f307fb543 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.854055 Sep 02 09:09:11.465100 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 24/44] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:10 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:11.469687 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:11.470365 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:11.478948 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:11.479575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:11.480085 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:11.480911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:11.481438 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:11.481932 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:11.803114 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:11.818407 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-65e6777f-3f92-49c2-aa83-4e0f70771459 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.352226 Sep 02 09:09:11.833451 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 25/45] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:11 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:11.837491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:11.843311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:11.864490 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:11.865558 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:11.867020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:11.868070 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:11.868779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:11.869608 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:12.625619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:12.633710 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:12.635186 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:12.636297 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-19bb350b-84f8-49c8-ad48-5d9a63f216ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.809305 Sep 02 09:09:12.636848 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 26/46] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:11 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:12.654775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:09:12.655348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:09:12.655700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:09:12.656110 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:09:12.656520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:09:12.671579 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:12.673955 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:12.677249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:12.678419 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:12.679228 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:12.679947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:12.703843 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:09:12.708714 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for user e8b5ce2249a84c01ab57c03b656b2949 and project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:09:12.722505 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:09:12.726098 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:09:12.802284 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-646dca3c-c5f1-43d2-812e-494990432eaf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.053454 Sep 02 09:09:12.803468 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 21/47] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:09:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 3056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:09:12.809701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:12.810550 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:12.820457 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:12.821178 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:12.822050 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:12.823287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:12.824183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:12.824890 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:12.896636 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-7acc58c6-3ef2-48cc-b96e-703d8e4f506d req-8ce2a043-3ade-4c9d-813c-bd55d7d1dc0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807e1961-dfb1-4260-b988-f6805f4d902f", "tag": "9b530bd8-db0e-487e-90cd-e4bdff16812e"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:12.922808 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7acc58c6-3ef2-48cc-b96e-703d8e4f506d req-8ce2a043-3ade-4c9d-813c-bd55d7d1dc0c service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:12.923339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7acc58c6-3ef2-48cc-b96e-703d8e4f506d req-8ce2a043-3ade-4c9d-813c-bd55d7d1dc0c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:12.923856 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7acc58c6-3ef2-48cc-b96e-703d8e4f506d req-8ce2a043-3ade-4c9d-813c-bd55d7d1dc0c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:12.946269 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-7acc58c6-3ef2-48cc-b96e-703d8e4f506d req-8ce2a043-3ade-4c9d-813c-bd55d7d1dc0c service nova] Creating event network-changed:9b530bd8-db0e-487e-90cd-e4bdff16812e for instance 807e1961-dfb1-4260-b988-f6805f4d902f on hv-cinder-85535 Sep 02 09:09:12.948205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7acc58c6-3ef2-48cc-b96e-703d8e4f506d req-8ce2a043-3ade-4c9d-813c-bd55d7d1dc0c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120573) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 09:09:12.948659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7acc58c6-3ef2-48cc-b96e-703d8e4f506d req-8ce2a043-3ade-4c9d-813c-bd55d7d1dc0c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120573) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 09:09:12.949760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6002b48c-2ccf-4758-b621-e9db2bc021f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:12.950272 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6002b48c-2ccf-4758-b621-e9db2bc021f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:12.950721 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6002b48c-2ccf-4758-b621-e9db2bc021f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:12.951484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6002b48c-2ccf-4758-b621-e9db2bc021f8 None None] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:12.951943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6002b48c-2ccf-4758-b621-e9db2bc021f8 None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:12.952368 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6002b48c-2ccf-4758-b621-e9db2bc021f8 None None] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:12.964624 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.compute.rpcapi [None req-6002b48c-2ccf-4758-b621-e9db2bc021f8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 09:09:12.966021 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6002b48c-2ccf-4758-b621-e9db2bc021f8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120573) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 09:09:12.991311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6002b48c-2ccf-4758-b621-e9db2bc021f8 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347009 Sep 02 09:09:12.994668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 27/48] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:13.002646 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:13.003831 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:13.012105 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:13.012858 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:13.013577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:13.016403 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:13.017760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:13.019374 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:13.148436 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:13.159242 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d0843cd5-299d-40a5-a84a-b3f9f5a20ee0 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1307 microversion: 2.1 time: 0.354487 Sep 02 09:09:13.175450 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 22/49] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:12 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:13.181091 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5d0625fb-b412-4d3e-a790-7e6ccb835fce tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:13.184273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5d0625fb-b412-4d3e-a790-7e6ccb835fce tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:13.190482 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:13.270296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5d0625fb-b412-4d3e-a790-7e6ccb835fce tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:13.276958 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5d0625fb-b412-4d3e-a790-7e6ccb835fce tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1240 microversion: 2.1 time: 0.100164 Sep 02 09:09:13.290435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 23/50] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:13 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:13.295839 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:13.296453 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:13.308727 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:13.309115 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:13.309557 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:13.310236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:13.310785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:13.311136 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:13.321114 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:13.332775 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-96ce3701-8ce4-4468-bbbe-07f78af79968 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.335479 Sep 02 09:09:13.334807 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 28/51] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:12 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:13.342657 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-b9e6b623-ac09-4287-8998-937b226271bb req-d12c67c3-2724-4fba-a242-a57bacbb950e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6b1337-6402-4108-aef8-2ad90760a201", "tag": "d40e6588-7e5a-43ac-bea3-7b456bc3d155"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:13.361263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b9e6b623-ac09-4287-8998-937b226271bb req-d12c67c3-2724-4fba-a242-a57bacbb950e service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:13.362312 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b9e6b623-ac09-4287-8998-937b226271bb req-d12c67c3-2724-4fba-a242-a57bacbb950e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:13.363200 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b9e6b623-ac09-4287-8998-937b226271bb req-d12c67c3-2724-4fba-a242-a57bacbb950e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:13.393434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-b9e6b623-ac09-4287-8998-937b226271bb req-d12c67c3-2724-4fba-a242-a57bacbb950e service nova] Creating event network-changed:d40e6588-7e5a-43ac-bea3-7b456bc3d155 for instance 5d6b1337-6402-4108-aef8-2ad90760a201 on hv-cinder-85535 Sep 02 09:09:13.399726 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-b9e6b623-ac09-4287-8998-937b226271bb req-d12c67c3-2724-4fba-a242-a57bacbb950e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063026 Sep 02 09:09:13.405129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 29/52] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:13.537446 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:13.547349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-83f9393f-6f46-4cec-8257-ecb86d5c2084 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.268404 Sep 02 09:09:13.548908 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 24/53] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:13 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:13.660962 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:13.661665 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:13.665392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:13.669424 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:13.669897 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:13.670323 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:13.671010 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:13.671486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:13.671904 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:13.819497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:13.831411 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:13.833029 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:13.834307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f5f77d1f-0b0e-48ff-aa75-5f0a3ca471cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.177410 Sep 02 09:09:13.835188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 30/54] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:13 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:14.183180 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:14.184317 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:14.190360 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.191003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.192033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:14.192737 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.193192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.193619 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:14.263230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:14.272141 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b51b4dd3-d09c-404d-b112-eb7642f7e95a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1307 microversion: 2.1 time: 0.094049 Sep 02 09:09:14.274157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 25/55] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:14 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:14.298990 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:14.300866 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:14.307377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.314386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.315514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:14.317144 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.317974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.319213 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:14.357043 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:14.357875 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:14.365172 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.365840 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.366889 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:14.367879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.368592 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.369160 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:14.398623 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:14.408136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ddf77fe5-86f7-465d-b914-d6195986302b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1244 microversion: 2.1 time: 0.113445 Sep 02 09:09:14.422012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 31/56] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:14 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1244 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:14.514099 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:14.522452 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8c0a4114-4f41-45a4-9e7f-1f056cd3363c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.169268 Sep 02 09:09:14.523019 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 26/57] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:14 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:14.568793 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:14.569639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:14.576037 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.576524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.576966 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:14.577656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.578148 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.578578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:14.733325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:14.741511 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6a286269-12c7-4c12-95cf-9b68d222e6a0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.176752 Sep 02 09:09:14.755791 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 32/58] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:14 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:14.855897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:14.856788 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:14.863261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.863743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.864176 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:14.864855 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:14.865307 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:14.865726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.017473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:15.025663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:15.027230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:15.028404 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-68aa5b15-d35c-4ef3-ac51-c6cf0930af96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.176402 Sep 02 09:09:15.029047 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 27/59] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:14 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:15.157693 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-a54359bd-e871-463b-a60b-949ee9e378f8 req-edf49b80-880d-4252-85d7-98482a07991d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21890f5d-be08-42c5-90ff-d0b7d69ac558", "tag": "9c13a5b8-3d5b-4814-811e-bfc0c4e8f17b"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:15.167005 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a54359bd-e871-463b-a60b-949ee9e378f8 req-edf49b80-880d-4252-85d7-98482a07991d service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:15.167610 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a54359bd-e871-463b-a60b-949ee9e378f8 req-edf49b80-880d-4252-85d7-98482a07991d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:15.168116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a54359bd-e871-463b-a60b-949ee9e378f8 req-edf49b80-880d-4252-85d7-98482a07991d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.179430 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-a54359bd-e871-463b-a60b-949ee9e378f8 req-edf49b80-880d-4252-85d7-98482a07991d service nova] Creating event network-changed:9c13a5b8-3d5b-4814-811e-bfc0c4e8f17b for instance 21890f5d-be08-42c5-90ff-d0b7d69ac558 on hv-cinder-85535 Sep 02 09:09:15.184190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-a54359bd-e871-463b-a60b-949ee9e378f8 req-edf49b80-880d-4252-85d7-98482a07991d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030167 Sep 02 09:09:15.184768 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 33/60] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:15.293022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:15.293680 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:15.299909 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:15.300388 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:15.300872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.301570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:15.301995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:15.302415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.306180 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=73 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:15.430477 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:15.431241 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:15.443469 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:15.444345 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:15.445677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.449389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:15.453961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:15.456622 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.548885 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:15.557161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-839a163f-c591-4595-8596-5584dede3200 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1307 microversion: 2.1 time: 0.267838 Sep 02 09:09:15.558067 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 28/61] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:15 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:15.563552 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:15.564143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:15.578738 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:15.579415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:15.579891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.580767 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:15.581276 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:15.581753 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.655998 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:15.677162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f2af9ed6-7809-46fb-b6b6-b34d1a675a03 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1236 microversion: 2.1 time: 0.251254 Sep 02 09:09:15.677758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 34/62] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:15 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1236 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:15.765917 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:15.767159 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:15.774534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:15.780256 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:15.783256 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.794472 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:15.797082 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:15.798642 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:15.840410 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:16.259849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:16.269210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-12f8584a-ba1c-4c1f-9f27-45d6fd5c72ef tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.709546 Sep 02 09:09:16.270455 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 29/63] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:15 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:16.284005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:16.286011 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:16.299897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:16.301208 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:16.302198 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:16.303225 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:16.304177 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:16.305224 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:16.340955 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:16.352233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c1f2b606-1715-4cae-b49d-2816bb60fe81 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.590504 Sep 02 09:09:16.356686 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 35/64] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:15 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:16.581493 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:16.584554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:16.591700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:16.592509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:16.593264 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:16.594235 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:16.595429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:16.596057 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:16.712184 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:16.712982 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:16.723218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:16.731302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:16.732925 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0ecf9a9b-5eeb-47ae-9d7b-186f7dd5da3f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.461222 Sep 02 09:09:16.738499 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3227277b-6d39-494e-8474-8a16ed3e90d6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1295 microversion: 2.1 time: 0.160846 Sep 02 09:09:16.751697 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 30/65] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:16 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:16.760464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:16.766222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:16.775846 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 36/66] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:16 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1295 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:16.790682 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:16.793996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:16.795450 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:16.797001 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:16.797924 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:16.802277 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:16.889418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:16.898868 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-25ccd70e-4fee-4c48-95d2-46c52fa633dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1300 microversion: 2.1 time: 0.145825 Sep 02 09:09:16.899523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 31/67] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:16 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1300 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:17.296713 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:17.297340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:17.316220 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:17.319430 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:17.320959 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:17.326674 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:17.327348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:17.327800 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:17.379355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:17.381448 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:17.389968 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:17.396629 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:17.397502 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:17.398960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:17.399929 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:17.400533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:17.713565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:17.722474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e4257934-ed1b-47fa-a6e5-99f77c9bbf94 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.435580 Sep 02 09:09:17.735204 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 37/68] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:17 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:17.744912 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:17.758370 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2b1e411-3e64-4eb0-bf45-26ebaa7a9337 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.385000 Sep 02 09:09:17.771602 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 32/69] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:17 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:17.771807 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:17.771807 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:17.773761 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:17.774259 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:17.774695 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:17.775435 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:17.775877 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:17.775990 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:17.776312 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:17.776903 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:17.789107 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:17.789885 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:17.790591 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:17.791765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:17.792664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:17.794184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:18.603165 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:18.617827 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:18.621056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:18.622499 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82bfdc59-955a-4326-971e-125143ff1bbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.862884 Sep 02 09:09:18.623338 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 38/70] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:17 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:18.636417 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:18.637470 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:18.644168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:18.644809 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:18.645353 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:18.646167 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:18.646628 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:18.647320 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:18.733008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:18.744871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-abf03126-4cce-4e45-9b3b-9cca599c8c82 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1298 microversion: 2.1 time: 0.112628 Sep 02 09:09:18.745714 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 39/71] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:18 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:18.751115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:18.751970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:18.759017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:18.759957 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:18.760533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:18.761404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:18.762003 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:18.762588 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:18.958947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:18.970119 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ae4de968-8df0-4cd3-8fb1-4e3f08c32d9d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 1.202544 Sep 02 09:09:18.970931 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 33/72] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:17 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:18.983144 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:18.987699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:18.998549 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:19.000325 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:19.000780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:19.004467 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:19.004954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:19.005393 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:19.214737 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:19.234946 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-843b4fc3-175b-4f3d-96cf-a1a35f67f42d tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.485123 Sep 02 09:09:19.237281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 40/73] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:18 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:19.249984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:19.254949 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-a8f5fde3-221c-45c5-9541-27949badaa4b req-249e3ddc-ad46-40d8-b8ba-9227b52f971a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c2d542-631f-4763-84db-ce759de2b8d8", "tag": "940c2d3a-4b9a-44d0-ace9-56e2f3dd7348"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:19.256222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-566f46fe-d58b-4329-84f9-832cd8475c99 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.282690 Sep 02 09:09:19.256809 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 34/74] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:18 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:19.266419 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a8f5fde3-221c-45c5-9541-27949badaa4b req-249e3ddc-ad46-40d8-b8ba-9227b52f971a service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:19.268128 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a8f5fde3-221c-45c5-9541-27949badaa4b req-249e3ddc-ad46-40d8-b8ba-9227b52f971a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:19.269100 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a8f5fde3-221c-45c5-9541-27949badaa4b req-249e3ddc-ad46-40d8-b8ba-9227b52f971a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:19.281079 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-a8f5fde3-221c-45c5-9541-27949badaa4b req-249e3ddc-ad46-40d8-b8ba-9227b52f971a service nova] Creating event network-changed:940c2d3a-4b9a-44d0-ace9-56e2f3dd7348 for instance 06c2d542-631f-4763-84db-ce759de2b8d8 on hv-cinder-85535 Sep 02 09:09:19.287143 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-a8f5fde3-221c-45c5-9541-27949badaa4b req-249e3ddc-ad46-40d8-b8ba-9227b52f971a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038610 Sep 02 09:09:19.291623 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 41/75] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:19.647268 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:19.648100 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:19.666537 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:19.667033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:19.667502 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:19.668197 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:19.668809 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:19.669380 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:19.770894 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:19.772195 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:19.785919 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:19.786352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:19.786790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:19.787590 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:19.790845 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:19.791423 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:20.193834 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:20.202204 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-539ffa47-1369-438e-acbb-5ca26592ce4e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1298 microversion: 2.1 time: 0.436598 Sep 02 09:09:20.216147 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 42/76] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:19 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1298 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:20.223411 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:20.224060 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:20.238328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:20.238825 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:20.239290 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:20.243919 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:20.244563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:20.245168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:20.291002 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:20.311344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:20.313874 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:20.315226 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b796067-7bdd-45fc-b52d-c739942ec37f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.671972 Sep 02 09:09:20.327755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 35/77] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:19 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:20.586195 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=8 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:20.614527 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-9dd94397-23fa-4c97-be92-5984e7646ed0 req-a0946405-e79b-4422-b98a-962f3a74b059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d56b84b-6132-4d68-8ead-b4a14070a060", "name": "network-vif-plugged", "status": "completed", "tag": "6063817b-61b3-404e-b9c1-6afc180fee12"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:20.633765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9dd94397-23fa-4c97-be92-5984e7646ed0 req-a0946405-e79b-4422-b98a-962f3a74b059 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:20.635605 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9dd94397-23fa-4c97-be92-5984e7646ed0 req-a0946405-e79b-4422-b98a-962f3a74b059 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:20.637303 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9dd94397-23fa-4c97-be92-5984e7646ed0 req-a0946405-e79b-4422-b98a-962f3a74b059 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:20.658701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-9dd94397-23fa-4c97-be92-5984e7646ed0 req-a0946405-e79b-4422-b98a-962f3a74b059 service nova] Creating event network-vif-plugged:6063817b-61b3-404e-b9c1-6afc180fee12 for instance 5d56b84b-6132-4d68-8ead-b4a14070a060 on hv-cinder-85535 Sep 02 09:09:20.667277 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-9dd94397-23fa-4c97-be92-5984e7646ed0 req-a0946405-e79b-4422-b98a-962f3a74b059 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336473 Sep 02 09:09:20.668036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 36/78] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:20.674229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:20.675877 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:20.677034 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:20.685290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:20.686136 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:20.686680 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:20.687533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:20.687920 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1818a631-9037-4d28-85ec-782bff51b7b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.470634 Sep 02 09:09:20.688115 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:20.688769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 43/79] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:20 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:20.691460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:20.693790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:20.694406 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:20.707160 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:20.711406 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:20.712231 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:20.713402 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:20.719981 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:20.720675 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:21.010640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:21.023787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-972d9b47-0924-406c-b5e2-3ba47f305caa tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.354088 Sep 02 09:09:21.024772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 37/80] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:20 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:21.034659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:21.046347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8bd8f3f3-e0f5-4a5e-bfb9-bd962de6d0fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.356259 Sep 02 09:09:21.060705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 44/81] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:20 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:21.224742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:21.225370 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:21.234620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:21.236773 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:21.237567 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:21.238424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:21.239214 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:21.242725 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:21.339741 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:21.348896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:21.364527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:21.365426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:21.368703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:21.369608 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:21.373522 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:21.373976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:22.428582 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:22.440121 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-27779ddd-202d-40af-ad5d-ef6f1848bb7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 1.220578 Sep 02 09:09:22.441006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 38/82] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:21 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:22.447832 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:22.449376 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:22.460248 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:22.460738 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:22.461165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:22.462115 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:22.462778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:22.463308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:22.492640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:22.500980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:22.505824 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:22.507106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c722be71-36b1-48bb-84cf-ca576cfe2bdd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 1.171078 Sep 02 09:09:22.507940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 45/83] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:21 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:22.513709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:22.514473 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:22.520937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:22.521701 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:22.522203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:22.522973 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:22.523609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:22.524102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:22.690861 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:22.694509 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:22.702236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-54a8f554-ec57-49fc-b705-e0fb516d44a4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.259846 Sep 02 09:09:22.703286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 39/84] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:22 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:22.708635 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:22.709356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:22.714436 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:22.715417 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:22.715982 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:22.716487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:22.718050 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:22.718557 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:22.719052 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:22.722924 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-44121dbd-48e6-4eef-9213-4d8744934ac4 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.213408 Sep 02 09:09:22.723641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 46/85] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:22 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:22.733421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-b8a1d28f-d81f-4973-b4a9-df4f2539aa7b req-015aae89-8e19-4e08-be49-f4b77cfb5cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e1961-dfb1-4260-b988-f6805f4d902f", "name": "network-vif-plugged", "status": "completed", "tag": "9b530bd8-db0e-487e-90cd-e4bdff16812e"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:22.743466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b8a1d28f-d81f-4973-b4a9-df4f2539aa7b req-015aae89-8e19-4e08-be49-f4b77cfb5cfb service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:22.744197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b8a1d28f-d81f-4973-b4a9-df4f2539aa7b req-015aae89-8e19-4e08-be49-f4b77cfb5cfb service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:22.745571 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b8a1d28f-d81f-4973-b4a9-df4f2539aa7b req-015aae89-8e19-4e08-be49-f4b77cfb5cfb service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:22.759101 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-b8a1d28f-d81f-4973-b4a9-df4f2539aa7b req-015aae89-8e19-4e08-be49-f4b77cfb5cfb service nova] Creating event network-vif-plugged:9b530bd8-db0e-487e-90cd-e4bdff16812e for instance 807e1961-dfb1-4260-b988-f6805f4d902f on hv-cinder-85535 Sep 02 09:09:22.764523 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-b8a1d28f-d81f-4973-b4a9-df4f2539aa7b req-015aae89-8e19-4e08-be49-f4b77cfb5cfb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039539 Sep 02 09:09:22.765329 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 47/86] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:23.023292 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:23.031022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-63c4129f-beaf-4264-92af-bd6475338763 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.326698 Sep 02 09:09:23.031622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 40/87] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:22 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:23.465141 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:23.466470 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:23.483387 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:23.488579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:23.489299 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:23.491681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:23.495686 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:23.504663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:23.506418 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:23.531378 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:23.532702 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:23.571293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=14 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:23.584721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:23.587703 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:23.591677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:23.594547 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:23.595118 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:23.595566 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:23.859937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:23.882030 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d9834409-949d-4c57-b41a-13d7a1cc06bb tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.423864 Sep 02 09:09:23.886199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:23.892219 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 48/88] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:23 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:23.895036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:23.898570 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:23.899215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:23.900543 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:23.901738 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1481b271-ce6e-4dbb-bbd1-b5ccf78c2256 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.375526 Sep 02 09:09:23.903514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 41/89] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:23 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:23.908582 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:23.909198 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:23.909586 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:23.910480 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:23.911133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:23.912140 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:23.913014 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:23.913623 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:23.915059 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:23.915582 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:23.921357 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:23.922510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:23.926308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:23.927614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:24.183866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:24.185579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:24.193558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eda6a493-a25d-4fad-b7d5-9e2b62c3ff1a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.288724 Sep 02 09:09:24.194010 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-79ba3743-c5aa-4d47-a249-431a1f491549 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.300268 Sep 02 09:09:24.194758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 49/90] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:23 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:24.201534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-f5d53c05-daff-40a6-adcd-def1e4866c6f req-3127caca-c5aa-4c49-977b-048244236fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d27c557-5d34-45da-93ea-f6c2a86a807e", "tag": "9b0d7846-3d45-4ced-b88d-87787c99ba4a"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:24.207351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 42/91] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:23 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:24.212314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f5d53c05-daff-40a6-adcd-def1e4866c6f req-3127caca-c5aa-4c49-977b-048244236fe7 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:24.213012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f5d53c05-daff-40a6-adcd-def1e4866c6f req-3127caca-c5aa-4c49-977b-048244236fe7 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:24.213615 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f5d53c05-daff-40a6-adcd-def1e4866c6f req-3127caca-c5aa-4c49-977b-048244236fe7 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:24.214375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:24.216896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:24.225672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-f5d53c05-daff-40a6-adcd-def1e4866c6f req-3127caca-c5aa-4c49-977b-048244236fe7 service nova] Creating event network-changed:9b0d7846-3d45-4ced-b88d-87787c99ba4a for instance 6d27c557-5d34-45da-93ea-f6c2a86a807e on hv-cinder-85535 Sep 02 09:09:24.228516 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:24.229175 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:24.229831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:24.230495 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-f5d53c05-daff-40a6-adcd-def1e4866c6f req-3127caca-c5aa-4c49-977b-048244236fe7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034367 Sep 02 09:09:24.230693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:24.231262 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 50/92] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:24.231592 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:24.232643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:24.368341 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:24.375989 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3e3d4fd3-acc3-4835-b319-1e63d22ef25f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.167595 Sep 02 09:09:24.376553 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 43/93] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:24 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:24.781777 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-db8d2e75-a6b1-4c5c-9e64-c8db72ed7812 req-ea7e909c-ee6e-4a11-b28e-ae5866b13fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21890f5d-be08-42c5-90ff-d0b7d69ac558", "name": "network-vif-plugged", "status": "completed", "tag": "9c13a5b8-3d5b-4814-811e-bfc0c4e8f17b"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:24.792399 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-db8d2e75-a6b1-4c5c-9e64-c8db72ed7812 req-ea7e909c-ee6e-4a11-b28e-ae5866b13fbd service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:24.793034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-db8d2e75-a6b1-4c5c-9e64-c8db72ed7812 req-ea7e909c-ee6e-4a11-b28e-ae5866b13fbd service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:24.793394 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-db8d2e75-a6b1-4c5c-9e64-c8db72ed7812 req-ea7e909c-ee6e-4a11-b28e-ae5866b13fbd service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:24.804648 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-db8d2e75-a6b1-4c5c-9e64-c8db72ed7812 req-ea7e909c-ee6e-4a11-b28e-ae5866b13fbd service nova] Creating event network-vif-plugged:9c13a5b8-3d5b-4814-811e-bfc0c4e8f17b for instance 21890f5d-be08-42c5-90ff-d0b7d69ac558 on hv-cinder-85535 Sep 02 09:09:24.809404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-db8d2e75-a6b1-4c5c-9e64-c8db72ed7812 req-ea7e909c-ee6e-4a11-b28e-ae5866b13fbd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031949 Sep 02 09:09:24.809984 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 51/94] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:24.902408 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:24.903013 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:24.908873 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:24.909349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:24.909785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:24.910459 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:24.910906 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:24.911350 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:24.929654 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:24.930491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:24.936634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:24.937121 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:24.937554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:24.938242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:24.939307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:24.939737 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:25.097152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:25.104808 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-20e6ea67-fd0b-4fdb-af55-fce38da29660 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.206268 Sep 02 09:09:25.105374 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 44/95] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:24 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:25.112960 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:25.120992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:25.122442 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:25.123578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-76b6b14e-0ef0-4b18-a9ee-97b74448e289 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.198168 Sep 02 09:09:25.124135 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 52/96] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:24 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:25.218120 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:25.218321 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:25.218838 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:25.218935 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:25.225083 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:25.225239 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:25.225586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:25.225862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:25.226013 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:25.226298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:25.226700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:25.226988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:25.227176 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:25.227474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:25.227576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:25.228004 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:25.242477 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:25.425561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:25.429287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:25.433323 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1cee0e69-f326-470f-8276-eaefad3d2585 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.218567 Sep 02 09:09:25.433892 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 53/97] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:25 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:25.436699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-20cc3c2e-e752-439c-b8d7-812afc67179a tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.222846 Sep 02 09:09:25.437402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 45/98] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:25 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:25.438229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:25.438922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:25.444811 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:25.445295 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:25.445766 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:25.446454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:25.447204 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:25.447629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:25.574349 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:25.577768 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:25.583401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-330c2d53-c28c-48eb-88fb-bd4cfc1338a5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.148482 Sep 02 09:09:25.583975 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 54/99] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:25 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:26.127291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:26.127905 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:26.133674 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.134152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.134576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.135274 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.135724 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.136138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.145954 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:26.146564 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:26.152487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.152962 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.153391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.154064 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.154514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.154929 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.336323 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:26.339051 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:26.344851 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:26.346295 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:26.347245 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-426ab58f-d9b3-40a8-ba55-212a8680afb7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.224282 Sep 02 09:09:26.347429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d0e4e6cd-7382-4f9d-9367-08b3cdb40fbb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.205821 Sep 02 09:09:26.347956 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 46/100] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:26 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:26.351737 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 55/101] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:26 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:26.455026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:26.455670 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:26.457243 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:26.457961 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:26.461576 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.462057 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.462488 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.463190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.463640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.463850 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.464057 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.464333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.464770 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.465458 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.465912 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.466333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.692006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:26.699456 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:26.707179 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7ee6da03-e424-4ed4-b7bf-c11cf36a31b4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.255880 Sep 02 09:09:26.711143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7b441429-f759-4462-b757-7f0a3f01a711 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.257601 Sep 02 09:09:26.724297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 47/102] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:26 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:26.724297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:26.724297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:26.725155 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 56/103] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:26 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:26.725236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.725236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.725236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.725236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:26.725785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:26.725785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:26.867245 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:26.874692 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-72f709ac-9140-477a-bd0a-b0e092bce4f9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.161817 Sep 02 09:09:26.875458 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 48/104] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:26 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:27.368015 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:27.368631 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:27.369345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:27.369963 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:27.376546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.376832 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.377194 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.377310 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.377752 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.377864 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.378463 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.378721 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.379477 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.379863 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.379972 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.380363 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.573256 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:27.580925 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:27.582242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-702ddb4a-469a-49bd-b2d0-6afb4012a058 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.218705 Sep 02 09:09:27.582814 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 57/105] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:27 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:27.589535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:27.590970 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:27.592178 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a8cafba2-a984-457a-9b4c-b0be538e5be7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.226680 Sep 02 09:09:27.606774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 49/106] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:27 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:27.728754 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:27.729373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:27.735839 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.736360 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.736799 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.737687 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.738163 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.738606 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.738723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:27.739296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:27.756579 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.757082 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.757522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.758226 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.758736 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.759192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.947894 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:27.955844 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2856e49d-8089-4dd6-8b7a-c9c8c80e08fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.231785 Sep 02 09:09:27.956418 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 58/107] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:27 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:27.961407 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:27.962544 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:27.964476 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:27.973307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.973441 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-33ffcc89-e234-4618-aba8-c113ae98b493 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.240181 Sep 02 09:09:27.973740 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.974176 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.974910 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:27.975436 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:27.975875 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:27.986827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 50/108] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:27 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:28.108874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:28.116992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e91816de-58f7-42dc-a2d6-a9e4ee427787 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.159338 Sep 02 09:09:28.117664 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 59/109] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:27 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:28.602267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:28.602882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:28.609869 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:28.610671 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:28.611304 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:28.612000 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:28.612695 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:28.613025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:28.613779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:28.614282 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:28.621198 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:28.621682 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:28.622113 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:28.622799 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:28.623278 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:28.623697 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:28.835546 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:28.843351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b8e8c592-e4da-4f7c-a596-768f3a41704d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.244869 Sep 02 09:09:28.843790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:28.844271 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 51/110] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:28 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:28.852865 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:28.854850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:28.856327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-511df4ae-d8ae-4864-8513-08b55e4033ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.246431 Sep 02 09:09:28.857034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 60/111] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:28 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:28.976239 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:28.976849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:28.982620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:28.983134 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:28.983572 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:28.984260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:28.984723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:28.985141 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:28.993830 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:28.994838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:29.000731 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:29.001849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:29.002347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:29.003224 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:29.003837 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:29.004414 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:29.187861 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:29.197158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7a9b1b52-dec1-4c55-aa60-cee29ca0e8e7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.224429 Sep 02 09:09:29.197744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 52/112] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:28 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:29.209647 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:29.210569 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d8757b6f-99a8-474a-8c40-edfd4f9eb4f1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1315 microversion: 2.1 time: 0.220479 Sep 02 09:09:29.211158 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 61/113] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:28 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:29.215007 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:29.217534 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:29.223922 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:29.224410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:29.224845 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:29.225541 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:29.225995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:29.226830 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:29.365342 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:29.372831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-55285f3a-3390-479c-a182-23cc3b621abb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.161636 Sep 02 09:09:29.373397 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 53/114] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:29 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:29.864088 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:29.864811 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:29.870855 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:29.871454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:29.871911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:29.872590 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:29.873041 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:29.873459 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:29.880212 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:29.880825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:29.888135 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:29.889035 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:29.889472 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:29.890349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:29.890797 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:29.891418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:30.480950 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:30.487872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:30.489019 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-de5efd57-6e13-4c3e-8946-c9c9b012cf3a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.628716 Sep 02 09:09:30.489524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 62/115] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:29 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:30.494502 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:30.495244 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:30.498005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:30.499742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:30.501631 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-89377520-0800-4a3c-a749-844d395d2a0c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.625964 Sep 02 09:09:30.502287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 54/116] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:29 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:30.508081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:30.509084 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:30.510640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:30.511150 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:30.511584 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:30.512275 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:30.512808 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:30.515769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:30.518296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:30.518994 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:30.520557 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:30.522715 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:30.522715 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:30.522715 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:30.915813 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:30.923502 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:30.924837 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b59245de-f463-4c02-9915-307aa8befdcc tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.433895 Sep 02 09:09:30.925515 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 63/117] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:30 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:30.931550 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:30.932415 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:30.939507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:30.940696 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:30.941226 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:30.941460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a1d88f32-d6f6-4896-845a-8bcb5ca12806 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1501 microversion: 2.1 time: 0.437348 Sep 02 09:09:30.942214 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 55/118] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:30 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1501 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:30.942327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:30.942785 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:30.943358 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:31.140304 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:31.155953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dd443123-62cc-4e2a-b6a9-8729b1392e2c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.229037 Sep 02 09:09:31.165086 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 64/119] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:30 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:31.367532 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-0ced3e23-afb3-4598-bafe-68e3e4cf6275 req-cbe5d2c1-59e9-4f2b-8ba7-4cf90f99997d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c2d542-631f-4763-84db-ce759de2b8d8", "name": "network-vif-plugged", "status": "completed", "tag": "940c2d3a-4b9a-44d0-ace9-56e2f3dd7348"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:31.381148 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0ced3e23-afb3-4598-bafe-68e3e4cf6275 req-cbe5d2c1-59e9-4f2b-8ba7-4cf90f99997d service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:31.381797 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0ced3e23-afb3-4598-bafe-68e3e4cf6275 req-cbe5d2c1-59e9-4f2b-8ba7-4cf90f99997d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:31.382372 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0ced3e23-afb3-4598-bafe-68e3e4cf6275 req-cbe5d2c1-59e9-4f2b-8ba7-4cf90f99997d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:31.396365 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-0ced3e23-afb3-4598-bafe-68e3e4cf6275 req-cbe5d2c1-59e9-4f2b-8ba7-4cf90f99997d service nova] Creating event network-vif-plugged:940c2d3a-4b9a-44d0-ace9-56e2f3dd7348 for instance 06c2d542-631f-4763-84db-ce759de2b8d8 on hv-cinder-85535 Sep 02 09:09:31.405558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-0ced3e23-afb3-4598-bafe-68e3e4cf6275 req-cbe5d2c1-59e9-4f2b-8ba7-4cf90f99997d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043075 Sep 02 09:09:31.410045 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 56/120] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:31.511342 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:31.511956 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:31.518373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:31.518860 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:31.519348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:31.520009 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:31.521940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:31.521940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:31.530003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:31.531153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:31.550798 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:31.551598 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:31.552137 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:31.552939 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:31.553647 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:31.554325 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:31.746816 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:31.754256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:31.755216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-00d509d7-065a-4c35-84e5-5f0a748dadde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.247577 Sep 02 09:09:31.755801 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 65/121] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:31 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:31.762385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:31.763849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:31.764930 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f55b24f6-3fd3-4214-bd91-96b03e246964 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.241008 Sep 02 09:09:31.765485 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 57/122] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:31 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:31.945736 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:31.946361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:31.953429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:31.953925 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:31.954355 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:31.955041 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:31.955515 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:31.955927 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:32.165152 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:32.173283 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-74d1b7da-7c72-4de6-a185-54c605c63f5a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.231412 Sep 02 09:09:32.173850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 66/123] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:31 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:32.192268 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:32.193680 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:32.200254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:32.200652 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:32.201249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:32.202113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:32.203378 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:32.203810 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:32.395049 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:32.401393 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1752982956", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "networks": [{"uuid": "fddd3ae7-592f-4937-aa54-9e2bbc2e9e43"}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:32.402947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-88bed529-e486-4d85-9fe8-3d9d28f0da37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1322 microversion: 2.1 time: 0.214993 Sep 02 09:09:32.403573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 58/124] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:32 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:32.454121 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] validate_networks() for [('fddd3ae7-592f-4937-aa54-9e2bbc2e9e43', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:09:32.549987 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-db0c4458-4302-4c76-99f3-941c99fe7f7e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "682695a0-54be-49c9-aa3f-38814fae37e8"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:32.552637 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-db0c4458-4302-4c76-99f3-941c99fe7f7e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:32.561386 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db0c4458-4302-4c76-99f3-941c99fe7f7e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:32.561872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db0c4458-4302-4c76-99f3-941c99fe7f7e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:32.562505 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db0c4458-4302-4c76-99f3-941c99fe7f7e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:32.564006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db0c4458-4302-4c76-99f3-941c99fe7f7e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:32.564635 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db0c4458-4302-4c76-99f3-941c99fe7f7e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:32.565199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db0c4458-4302-4c76-99f3-941c99fe7f7e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:32.852456 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:09:32.852933 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:09:32.853457 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:09:32.854078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:09:32.854745 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:09:32.864928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:32.865487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:32.865922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:32.866672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:32.867216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:32.867667 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:32.883882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Getting quotas for project 85a7c3487e204650adc69b55ef3feb66. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:09:32.893118 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Getting quotas for user e1daf1c8526245a9854f9b8672fa4222 and project 85a7c3487e204650adc69b55ef3feb66. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:09:32.906790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:09:32.909672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:09:32.956552 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-23447f19-b8a7-4aa2-b021-1e147690069b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558863 Sep 02 09:09:32.957485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 67/125] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:09:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 09:09:32.965149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:32.965149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:32.968767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:32.969252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:32.970185 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:32.970873 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:32.972129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:32.972129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.108779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:33.117970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-36519328-ec51-4452-a2c2-3ae8e75de55c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.159483 Sep 02 09:09:33.118570 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 68/126] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:32 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:33.122955 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:33.123619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:33.129110 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.129594 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.130030 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.130720 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.131207 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.131635 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.268448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:33.276676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:33.278132 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:33.279385 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-921d0642-1b74-41cc-a4c5-804d0e434fc6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.159876 Sep 02 09:09:33.280035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 69/127] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:33 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:33.284925 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a222a8e7-8616-48e3-881e-48ff1f7539b2 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:33.285694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a222a8e7-8616-48e3-881e-48ff1f7539b2 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:33.342890 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a222a8e7-8616-48e3-881e-48ff1f7539b2 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:33.350540 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a222a8e7-8616-48e3-881e-48ff1f7539b2 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1219 microversion: 2.1 time: 0.069476 Sep 02 09:09:33.352225 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 70/128] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:33 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:33.357326 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:33.357936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:33.367874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.368359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.368882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.369637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.370129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.370554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.501091 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:33.509432 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04044da6-2bea-48b6-8aec-ccf8c33979fa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.156065 Sep 02 09:09:33.510036 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 71/129] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:33 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:33.514537 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:33.515163 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:33.517888 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:33.522245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.522747 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.523213 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.523953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.524434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.524860 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.652358 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:33.660005 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-00a4e403-46b0-47a7-ade7-3f43c87674bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1516 microversion: 2.1 time: 0.148967 Sep 02 09:09:33.660568 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 72/130] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:33 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:33.666690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-6cbede9d-2fc3-42bd-b3e5-2731f8c41c9a req-822cdcc3-1760-4634-8d29-42bf87607e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6b1337-6402-4108-aef8-2ad90760a201", "name": "network-vif-plugged", "status": "completed", "tag": "d40e6588-7e5a-43ac-bea3-7b456bc3d155"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:33.674462 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6cbede9d-2fc3-42bd-b3e5-2731f8c41c9a req-822cdcc3-1760-4634-8d29-42bf87607e0d service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.674937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6cbede9d-2fc3-42bd-b3e5-2731f8c41c9a req-822cdcc3-1760-4634-8d29-42bf87607e0d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.675394 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6cbede9d-2fc3-42bd-b3e5-2731f8c41c9a req-822cdcc3-1760-4634-8d29-42bf87607e0d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.679357 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:33.687012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-6cbede9d-2fc3-42bd-b3e5-2731f8c41c9a req-822cdcc3-1760-4634-8d29-42bf87607e0d service nova] Creating event network-vif-plugged:d40e6588-7e5a-43ac-bea3-7b456bc3d155 for instance 5d6b1337-6402-4108-aef8-2ad90760a201 on hv-cinder-85535 Sep 02 09:09:33.693918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-6cbede9d-2fc3-42bd-b3e5-2731f8c41c9a req-822cdcc3-1760-4634-8d29-42bf87607e0d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032256 Sep 02 09:09:33.694644 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 73/131] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:33.700216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:33.702510 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:33.709300 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.709787 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.710216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.710951 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.711443 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.711869 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.779588 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lazy-loading 'flavor' on Instance uuid 21890f5d-be08-42c5-90ff-d0b7d69ac558 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:09:33.904536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9afac1ef-a1fc-41f6-bc5f-a5b2b844401a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558/action" status: 200 len: 32 microversion: 2.1 time: 0.208571 Sep 02 09:09:33.905233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 74/132] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:09:33 2022] POST /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:09:33.914982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:33.915711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:33.921764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.922252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.923238 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:33.923940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:33.924406 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:33.924834 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:34.057204 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:34.065465 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f41d9401-b0a6-458e-975f-a6cbc38e99d7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.154561 Sep 02 09:09:34.066032 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 75/133] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:33 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:34.137770 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:34.138407 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:34.144149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:34.144629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:34.145058 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:34.145740 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:34.146192 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:34.146612 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:34.271715 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:34.279203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4fa5624-be1f-4513-894c-3851473af07d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.145075 Sep 02 09:09:34.279766 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 76/134] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:34 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:34.302615 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:34.303245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:34.308893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:34.309307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:34.309732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:34.310403 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:34.310885 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:34.311354 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:34.439083 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:34.447547 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:34.448973 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:34.450073 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3640b0c4-e56c-4df8-8ea6-f411eda9901a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.151117 Sep 02 09:09:34.450641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 77/135] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:34 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:34.455658 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:34.456255 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:34.461828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:34.462299 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:34.462723 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:34.463426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:34.463873 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:34.464288 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:34.524541 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:34.531812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-38c1c0ac-04a5-4950-ad9e-d3191a6577e7 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1223 microversion: 2.1 time: 0.079572 Sep 02 09:09:34.532920 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 78/136] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:34 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:34.537138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:34.537735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:34.542973 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:34.543482 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:34.543910 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:34.544581 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:34.545029 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:34.545447 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:34.669663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:34.677156 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5d8b0ffc-44e3-4afa-aac5-b7d9f685a0cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1362 microversion: 2.1 time: 0.143340 Sep 02 09:09:34.677710 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 79/137] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:34 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:35.086590 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:35.088055 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:35.094660 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.095470 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.096142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.097058 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.097696 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.098263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.244764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:35.253033 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5ccaaaa7-227a-45b6-875d-bd17b139a842 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.170615 Sep 02 09:09:35.254195 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 80/138] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:35 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:35.302296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:35.303119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:35.310854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.313138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.315135 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.317082 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.318799 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.321032 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.453712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:35.461271 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-64a86b06-c063-4b78-8709-df37d7ec6f25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.165140 Sep 02 09:09:35.461833 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 81/139] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:35 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:35.471858 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:35.472457 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:35.478185 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.478669 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.479125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.479816 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.480266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.480690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.609401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:35.617758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:35.619214 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:35.620307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0224cfb2-a6b0-4882-981b-bcd6c0a83524 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.151973 Sep 02 09:09:35.620883 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 82/140] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:35 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:35.634651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:35.634651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:35.634651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.634651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.635008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.635008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.635008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.635008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.691168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:35.698828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-64cbc411-62bf-4efb-94fe-505124ce3119 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1215 microversion: 2.1 time: 0.077025 Sep 02 09:09:35.699446 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 83/141] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:35 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:35.703744 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:35.704846 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:35.710205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.710680 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.711137 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.711817 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.712271 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.712689 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.839022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:35.846524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9b3e9103-1fcb-4ab4-a6e1-bc7ad75552f4 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1548 microversion: 2.1 time: 0.146156 Sep 02 09:09:35.847105 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 84/142] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:35 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:35.866183 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-309649e9-96c3-4b9d-a8e0-4ce60bf862a5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:35.866663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-309649e9-96c3-4b9d-a8e0-4ce60bf862a5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:35.872117 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-309649e9-96c3-4b9d-a8e0-4ce60bf862a5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.872591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-309649e9-96c3-4b9d-a8e0-4ce60bf862a5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.873015 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-309649e9-96c3-4b9d-a8e0-4ce60bf862a5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.873681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-309649e9-96c3-4b9d-a8e0-4ce60bf862a5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:35.874122 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-309649e9-96c3-4b9d-a8e0-4ce60bf862a5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:35.874530 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-309649e9-96c3-4b9d-a8e0-4ce60bf862a5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:35.952546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-309649e9-96c3-4b9d-a8e0-4ce60bf862a5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089718 Sep 02 09:09:35.953142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 85/143] 10.222.0.36 () {58 vars in 1275 bytes} [Fri Sep 2 09:09:35 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:09:36.274976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:36.275798 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:36.281940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:36.283355 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:36.283937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:36.284766 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:36.285237 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:36.285814 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:36.641741 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:36.650328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6db5ec0e-203a-4ecd-8c49-e32239e20b77 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.380189 Sep 02 09:09:36.650901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 86/144] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:36 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:36.655279 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:36.655882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:36.661620 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:36.662103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:36.662530 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:36.663259 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:36.663696 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:36.664114 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:36.966937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:36.974652 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8fd5ad09-2320-40d1-9ac4-5c102e407109 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.322753 Sep 02 09:09:36.988028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 87/145] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:36 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:36.988028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:36.988028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:36.988028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:36.988474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:36.988474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:36.988474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:36.988474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:36.988787 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:37.218899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:37.222916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:37.230603 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:37.232067 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:37.233215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1b64c9dc-c7e2-4004-9ff1-6859fcfa1d03 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.257040 Sep 02 09:09:37.247092 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 88/146] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:36 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:37.247092 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:37.247092 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:37.252530 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:37.253218 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:37.253714 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:37.254474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:37.254924 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:37.255369 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:37.340052 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:37.348826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d3d3eb2-069b-4c95-a0b1-a7e831152560 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1215 microversion: 2.1 time: 0.113488 Sep 02 09:09:37.359845 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 89/147] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:37 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:37.511398 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-50b8879b-c2a7-434b-9480-dd66d3cd5925 req-63bf2821-8349-49e4-8dd2-b785c152ebe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c2d542-631f-4763-84db-ce759de2b8d8", "tag": "940c2d3a-4b9a-44d0-ace9-56e2f3dd7348"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:37.520904 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-50b8879b-c2a7-434b-9480-dd66d3cd5925 req-63bf2821-8349-49e4-8dd2-b785c152ebe4 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:37.521384 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-50b8879b-c2a7-434b-9480-dd66d3cd5925 req-63bf2821-8349-49e4-8dd2-b785c152ebe4 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:37.521817 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-50b8879b-c2a7-434b-9480-dd66d3cd5925 req-63bf2821-8349-49e4-8dd2-b785c152ebe4 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:37.533168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-50b8879b-c2a7-434b-9480-dd66d3cd5925 req-63bf2821-8349-49e4-8dd2-b785c152ebe4 service nova] Creating event network-changed:940c2d3a-4b9a-44d0-ace9-56e2f3dd7348 for instance 06c2d542-631f-4763-84db-ce759de2b8d8 on hv-cinder-85535 Sep 02 09:09:37.538225 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-50b8879b-c2a7-434b-9480-dd66d3cd5925 req-63bf2821-8349-49e4-8dd2-b785c152ebe4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030412 Sep 02 09:09:37.538809 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 90/148] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:09:37.671758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:37.672388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:37.678483 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:37.678983 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:37.679453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:37.680145 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:37.680603 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:37.681029 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:37.812102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:37.819818 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-50737c64-eed8-4d17-8f2e-3e1ab1121524 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.152425 Sep 02 09:09:37.820475 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 91/149] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:37 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:37.995911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:37.996465 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:38.002921 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:38.003425 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:38.003851 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:38.004529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:38.004995 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:38.005391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:38.129308 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:38.136791 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5c591d53-c008-41a7-8a73-a5e5ddf997e4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.144837 Sep 02 09:09:38.137358 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 92/150] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:37 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:38.261903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:38.262558 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:38.273238 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:38.273632 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:38.274066 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:38.274771 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:38.275249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:38.275671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:38.427622 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:38.440031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:38.442054 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:38.446458 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25fc39a2-74c0-43d0-b879-dd71342d7495 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.188311 Sep 02 09:09:38.447037 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 93/151] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:38 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:38.452387 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:38.453181 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:38.460497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:38.461237 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:38.461849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:38.462745 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:38.463221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:38.463790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:38.537977 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:38.549075 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fd15d02e-db78-4510-86d8-49e6da53a27a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1215 microversion: 2.1 time: 0.099106 Sep 02 09:09:38.549075 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 94/152] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:38 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:38.841534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:38.842150 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:38.848618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:38.849129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:38.849570 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:38.850255 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:38.850712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:38.851167 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:38.974700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:38.982285 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b1eb498e-e774-4dc9-9950-0b917e348413 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.144754 Sep 02 09:09:38.982839 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 95/153] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:38 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:39.158244 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:39.158874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:39.164742 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:39.165220 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:39.165647 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:39.166320 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:39.166767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:39.167210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:39.293491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:39.301624 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-243f65b9-19b9-4f3d-8244-3c04f5113adc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.147768 Sep 02 09:09:39.302191 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 96/154] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:39 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:39.468681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:39.469283 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:39.475251 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:39.475741 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:39.476177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:39.476876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:39.477335 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:39.477763 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:39.617926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:39.626696 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:39.628344 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:39.629554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-602b145c-6c1c-455e-a6e4-4148ffe680c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.164759 Sep 02 09:09:39.630311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 97/155] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:39 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:39.634749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:39.635521 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:39.643915 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:39.644405 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:39.644881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:39.647132 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:39.647132 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:39.647132 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:39.709150 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:39.716743 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-11503ed4-023e-4d8c-80ec-f9042f08c79f tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1215 microversion: 2.1 time: 0.085504 Sep 02 09:09:39.717398 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 98/156] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:39 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:40.003953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:40.004474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:40.010336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:40.010817 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:40.011285 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:40.011965 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:40.012417 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:40.012840 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:40.136352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:40.143823 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c3555995-2e8d-48ea-8bb7-59f440337b49 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.144458 Sep 02 09:09:40.144385 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 99/157] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:39 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:40.321641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:40.322458 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:40.328323 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:40.328802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:40.329235 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:40.329916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:40.330366 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:40.330791 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:40.455663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:40.463833 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1343646e-2148-4952-9367-487e57a0f21a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.146106 Sep 02 09:09:40.464391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 100/158] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:40 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:40.651685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:40.652295 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:40.658834 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:40.659341 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:40.659776 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:40.660465 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:40.660918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:40.661372 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:40.790232 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:40.798250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:40.799721 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:40.800842 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c7f45b37-8550-4689-b1b2-b71faeee6487 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.153264 Sep 02 09:09:40.801388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 101/159] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:40 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:40.805651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:40.806270 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:40.811721 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:40.812198 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:40.812643 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:40.813285 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:40.813732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:40.814145 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:40.871720 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:40.879185 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5a5e13b5-bab7-4fe2-bb5a-d39b72895210 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1215 microversion: 2.1 time: 0.076785 Sep 02 09:09:40.879683 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 102/160] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:40 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:41.164098 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:41.164609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:41.170445 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:41.170925 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:41.171383 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:41.172065 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:41.172525 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:41.173522 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:41.295155 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:41.303237 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9e047143-6e14-40cb-b73f-4227e9a6838c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.142990 Sep 02 09:09:41.303797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 103/161] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:41 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:41.484563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:41.485792 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:41.492036 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:41.492522 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:41.492948 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:41.493645 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:41.494094 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:41.494509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:41.800429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:41.811690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8f4e94f4-498c-4ed9-be2e-ffd9663a077a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.330907 Sep 02 09:09:41.812626 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 104/162] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:41 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:41.824027 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:41.824692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:41.831790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:41.832318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:41.832774 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:41.833609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:41.834231 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:41.834807 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:41.866953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-db0c4458-4302-4c76-99f3-941c99fe7f7e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "POST /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.321419 Sep 02 09:09:41.867902 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 59/163] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:09:32 2022] POST /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f/os-volume_attachments => generated 194 bytes in 9323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:09:41.901314 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:41.902012 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:41.910712 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:41.911234 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:41.911679 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:41.912385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:41.912840 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:41.913261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:42.143548 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:42.151082 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d75ebd15-c544-4b3f-95ef-0ca0ab7d86c9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1271 microversion: 2.1 time: 0.254814 Sep 02 09:09:42.151666 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 60/164] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:41 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:42.201393 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:42.209221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:42.210667 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:42.211803 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9564c11c-4658-4a3e-89cc-a991499c680e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.392648 Sep 02 09:09:42.212363 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 105/165] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:41 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:42.324180 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:42.324814 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:42.331147 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:42.331633 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:42.332062 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:42.332742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:42.333193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:42.333613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:42.348065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:42.462560 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:42.470800 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-72714fc8-238b-4f7a-bec6-8ea6127cefa7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.150709 Sep 02 09:09:42.471395 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 61/166] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:42 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:42.838210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:42.839261 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:42.848158 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:42.848672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:42.849103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:42.849822 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:42.850253 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:42.850667 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:42.855935 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:42.874951 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:42.983690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:42.992406 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7800800a-f8dd-4725-b6cd-64fbdfe64b7e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.160187 Sep 02 09:09:42.992963 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 106/167] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:42 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:43.176789 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:43.177429 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:43.183788 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:43.184269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:43.184692 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:43.185371 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:43.185821 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:43.186239 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:43.233628 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:43.234236 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:43.240503 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:43.241061 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:43.241489 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:43.242177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:43.242634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:43.243058 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:43.248103 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:43.256208 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d0da0197-dc54-47d4-b1f4-d06693093d68 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1271 microversion: 2.1 time: 0.083748 Sep 02 09:09:43.257065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 62/168] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:43 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:43.347542 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=8 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:43.373168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:43.381078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:43.382516 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:43.383653 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f0c10973-823d-497e-b4f7-28bd6db93b63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.153888 Sep 02 09:09:43.384208 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 107/169] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:43 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:09:43.491360 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:43.491973 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:43.493836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=81 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:43.499212 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:43.499695 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:43.500128 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:43.500813 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:43.501284 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:43.501688 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:43.629456 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:43.637001 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-450341d0-8967-4d2e-9807-a1ef46010843 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.149529 Sep 02 09:09:43.637558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 63/170] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:43 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:44.012982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:44.013593 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:44.020140 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:44.020619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:44.021048 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:44.021732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:44.022185 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:44.022607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:44.149185 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:44.156652 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e4f9ef44-8a54-4c44-bb93-5d5748e5705d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.147406 Sep 02 09:09:44.157225 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 108/171] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:44 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:44.276356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:44.276957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:44.283281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:44.283754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:44.284177 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:44.284846 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:44.285294 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:44.285712 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:44.347504 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:44.355224 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-13bce68b-1bd6-43b2-bd09-fcb6b2f062a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1271 microversion: 2.1 time: 0.082586 Sep 02 09:09:44.356007 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 64/172] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:44 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:44.404402 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:44.405008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:44.410895 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:44.411415 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:44.411848 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:44.412531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:44.412988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:44.413408 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:44.537080 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:44.544884 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:44.546369 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:44.547427 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1709c962-a5f7-4e4a-bf47-02ff1bcf14ff tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.146879 Sep 02 09:09:44.548489 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 109/173] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:44 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:44.657875 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:44.658482 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:44.664305 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:44.664775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:44.665199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:44.665869 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:44.666336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:44.666751 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:44.797394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:44.805574 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4792fc13-5905-41ee-83c5-69384f96109d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.151495 Sep 02 09:09:44.806130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 65/174] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:44 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:45.176944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:45.177478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:45.183994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:45.184609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:45.185043 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:45.185725 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:45.186205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:45.186704 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:45.324035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:45.332354 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c073ad4a-7471-4bfe-a46e-a234decb8139 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.159338 Sep 02 09:09:45.332918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 110/175] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:45 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:45.375205 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:45.375811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:45.382114 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:45.382588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:45.383012 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:45.383710 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:45.384157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:45.384572 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:45.444017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:45.451744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac682290-06c2-4f2c-98e8-7f57995ae5e3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1271 microversion: 2.1 time: 0.080513 Sep 02 09:09:45.452304 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 66/176] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:45 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:45.571336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:45.571962 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:45.580238 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:45.580884 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:45.581328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:45.582078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:45.582771 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:45.583162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:45.736390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-38a067db-233e-4a71-9c84-86fe97357ba6 req-18dcaa32-4b2d-44ec-bb1c-908819280834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d27c557-5d34-45da-93ea-f6c2a86a807e", "name": "network-vif-plugged", "status": "completed", "tag": "9b0d7846-3d45-4ced-b88d-87787c99ba4a"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:45.750321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-38a067db-233e-4a71-9c84-86fe97357ba6 req-18dcaa32-4b2d-44ec-bb1c-908819280834 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:45.751920 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-38a067db-233e-4a71-9c84-86fe97357ba6 req-18dcaa32-4b2d-44ec-bb1c-908819280834 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:45.752367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-38a067db-233e-4a71-9c84-86fe97357ba6 req-18dcaa32-4b2d-44ec-bb1c-908819280834 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:45.770625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-38a067db-233e-4a71-9c84-86fe97357ba6 req-18dcaa32-4b2d-44ec-bb1c-908819280834 service nova] Creating event network-vif-plugged:9b0d7846-3d45-4ced-b88d-87787c99ba4a for instance 6d27c557-5d34-45da-93ea-f6c2a86a807e on hv-cinder-85535 Sep 02 09:09:45.778209 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-38a067db-233e-4a71-9c84-86fe97357ba6 req-18dcaa32-4b2d-44ec-bb1c-908819280834 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047299 Sep 02 09:09:45.778812 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 67/177] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:09:45.830661 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:45.831402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:45.837523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:45.838007 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:45.838436 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:45.839149 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:45.839253 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:45.839598 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:45.840010 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:45.847791 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:45.849229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:45.850334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bd430aa4-fc2f-44d7-90ef-61d3558fc37a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1407 microversion: 2.20 time: 0.283925 Sep 02 09:09:45.850883 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 111/178] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:45 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:45.971527 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:45.981059 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e12c9d1a-2e63-4ca4-9b20-09c3e599d914 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.158858 Sep 02 09:09:45.982438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 68/179] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:45 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:46.353310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:46.354008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:46.360052 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:46.361103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:46.361539 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:46.362257 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:46.362762 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:46.363228 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:46.473576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:46.474116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:46.480411 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:46.480888 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:46.481318 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:46.482001 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:46.482459 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:46.482881 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:46.490419 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:46.498146 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-53e233ab-1eea-460b-95dc-1c1a39964e69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.148732 Sep 02 09:09:46.498815 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 112/180] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:46 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:46.544060 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:46.552281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-47628bb3-8c74-46b9-979a-39f997dc8f02 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1271 microversion: 2.1 time: 0.083111 Sep 02 09:09:46.552807 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 69/181] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:46 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:46.872663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:46.873294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:46.880249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:46.881153 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:46.881293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:46.881909 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:46.882452 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:46.882866 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:47.018813 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:47.019646 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:47.028837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:47.029489 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:47.030219 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:47.031687 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:47.032345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:47.032976 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:47.068779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:47.077740 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:47.080042 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:47.081460 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-236b7066-96b3-43da-bea7-dd0382650ee3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1598 microversion: 2.20 time: 0.212725 Sep 02 09:09:47.083370 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 113/182] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:09:46 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1598 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:09:47.105381 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-10900eda-7e27-42c0-b239-c8cf8ecbeac7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:47.105893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-10900eda-7e27-42c0-b239-c8cf8ecbeac7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:47.111851 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10900eda-7e27-42c0-b239-c8cf8ecbeac7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:47.112339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10900eda-7e27-42c0-b239-c8cf8ecbeac7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:47.112824 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10900eda-7e27-42c0-b239-c8cf8ecbeac7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:47.113694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10900eda-7e27-42c0-b239-c8cf8ecbeac7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:47.114169 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10900eda-7e27-42c0-b239-c8cf8ecbeac7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:47.114585 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10900eda-7e27-42c0-b239-c8cf8ecbeac7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:47.202531 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:47.213150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d5c1455f-adc2-47c6-96c7-e6e4c5947f9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.199040 Sep 02 09:09:47.227934 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-10900eda-7e27-42c0-b239-c8cf8ecbeac7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118738 Sep 02 09:09:47.227934 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 114/183] 10.222.0.36 () {60 vars in 1316 bytes} [Fri Sep 2 09:09:47 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:09:47.230646 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 70/184] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:47 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:47.519814 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:47.520528 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:47.526858 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:47.527521 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:47.528219 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:47.529152 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:47.529816 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:47.530441 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:47.572250 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:47.573157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:47.580969 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:47.581508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:47.582285 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:47.583058 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:47.583576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:47.583993 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:47.741763 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:47.750146 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f2ff8dd-94d0-4b08-a269-0422bc643d65 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1271 microversion: 2.1 time: 0.181610 Sep 02 09:09:47.752394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 71/185] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:47 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:47.845516 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:47.854830 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c25a49d0-d7b4-4f83-9b64-939403e4e539 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.340741 Sep 02 09:09:47.855683 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 115/186] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:47 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:48.236369 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:48.236984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:48.244390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:48.244882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:48.249868 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:48.254641 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:48.255219 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:48.255837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:48.530668 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:48.543940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ee639796-cdb9-46db-b56e-a317c1ee2f3d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.310861 Sep 02 09:09:48.544875 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 72/187] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:48 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:48.773327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:48.773327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:48.779047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:48.779697 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:48.780205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:48.781060 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:48.781260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-c60246ea-02df-42db-b8cc-d9a79041caed req-0ccfc7f0-fd70-4b9f-a224-4354ff290ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6b1337-6402-4108-aef8-2ad90760a201", "tag": "d40e6588-7e5a-43ac-bea3-7b456bc3d155"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:48.781660 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:48.782512 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:48.792261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-c60246ea-02df-42db-b8cc-d9a79041caed req-0ccfc7f0-fd70-4b9f-a224-4354ff290ac0 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:48.792791 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-c60246ea-02df-42db-b8cc-d9a79041caed req-0ccfc7f0-fd70-4b9f-a224-4354ff290ac0 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:48.793619 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-c60246ea-02df-42db-b8cc-d9a79041caed req-0ccfc7f0-fd70-4b9f-a224-4354ff290ac0 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:48.806155 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-c60246ea-02df-42db-b8cc-d9a79041caed req-0ccfc7f0-fd70-4b9f-a224-4354ff290ac0 service nova] Creating event network-changed:d40e6588-7e5a-43ac-bea3-7b456bc3d155 for instance 5d6b1337-6402-4108-aef8-2ad90760a201 on hv-cinder-85535 Sep 02 09:09:48.810925 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-c60246ea-02df-42db-b8cc-d9a79041caed req-0ccfc7f0-fd70-4b9f-a224-4354ff290ac0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033228 Sep 02 09:09:48.811745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 73/188] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:09:48.877378 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:48.878097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:48.884385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:48.884877 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:48.885319 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:48.886008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:48.886865 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:48.887623 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:48.897294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:48.906297 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3a812f17-d521-46cc-85ef-38322573d726 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1277 microversion: 2.1 time: 0.138404 Sep 02 09:09:48.908445 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 116/189] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:48 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:49.116570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:49.126208 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-76c35700-410d-4411-b1e8-c6bc7cd486e1 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.253736 Sep 02 09:09:49.126865 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 74/190] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:48 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:49.569713 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:49.570274 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:49.579352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:49.580267 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:49.580877 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:49.581788 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:49.582486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:49.583356 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:49.836711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:49.844611 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2aa3883d-9c12-4cbf-973b-e2ab834020e0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.282654 Sep 02 09:09:49.855500 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 117/191] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:49 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:49.927563 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:49.928996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:49.946445 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:49.948290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:49.950011 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:49.953462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:49.954344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:49.955033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:50.148683 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:50.149326 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:50.155679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:50.156249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:50.156696 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:50.157513 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:50.158152 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:50.158566 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:50.255332 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:50.264544 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8cb29045-6413-41cd-8387-f16a48bd1e2d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.340768 Sep 02 09:09:50.266110 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 75/192] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:49 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:50.373334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:50.383449 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7c58daff-f45b-463d-9b41-84283dcae893 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1365 microversion: 2.1 time: 0.238582 Sep 02 09:09:50.384632 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 118/193] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:50 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:50.710726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-bcc92f70-9156-4396-8c97-ba2b6f9b9f8e req-d009b45f-80c8-4e40-bb81-105fc02d2077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7331a63-41b1-44e3-8eec-2498b8817212", "tag": "6e50eb45-f687-438f-abeb-4bd6303fc38b"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:50.723521 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bcc92f70-9156-4396-8c97-ba2b6f9b9f8e req-d009b45f-80c8-4e40-bb81-105fc02d2077 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:50.724173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bcc92f70-9156-4396-8c97-ba2b6f9b9f8e req-d009b45f-80c8-4e40-bb81-105fc02d2077 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:50.724958 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bcc92f70-9156-4396-8c97-ba2b6f9b9f8e req-d009b45f-80c8-4e40-bb81-105fc02d2077 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:50.743454 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-bcc92f70-9156-4396-8c97-ba2b6f9b9f8e req-d009b45f-80c8-4e40-bb81-105fc02d2077 service nova] Creating event network-changed:6e50eb45-f687-438f-abeb-4bd6303fc38b for instance e7331a63-41b1-44e3-8eec-2498b8817212 on hv-cinder-85535 Sep 02 09:09:50.749531 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-bcc92f70-9156-4396-8c97-ba2b6f9b9f8e req-d009b45f-80c8-4e40-bb81-105fc02d2077 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044229 Sep 02 09:09:50.750478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 76/194] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:50.868682 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:50.869289 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:50.875389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:50.875923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:50.876599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:50.877301 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:50.877861 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:50.879510 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:51.049503 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:51.060511 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-83b67d91-2a07-4431-9967-18ade1347a0c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.195426 Sep 02 09:09:51.061173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 119/195] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:50 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:51.286706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:51.287423 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:51.294006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:51.294492 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:51.294915 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:51.295621 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:51.296123 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:51.296485 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:51.405388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:51.405684 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:51.413664 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:51.414151 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:51.415171 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:51.416029 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:51.416638 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:51.417524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:51.564844 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:51.572777 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aef960a7-b231-4ac0-8962-99835b51bec5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.290627 Sep 02 09:09:51.573436 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 77/196] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:51 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:51.593215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:51.601274 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d8f3601b-d585-45b3-9599-9bb7f35eede9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1556 microversion: 2.1 time: 0.200327 Sep 02 09:09:51.601987 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 120/197] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:51 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:51.622778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f7ef506c-7278-4d78-b5ff-2e3c8d17199f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:51.623202 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f7ef506c-7278-4d78-b5ff-2e3c8d17199f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:51.629452 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7ef506c-7278-4d78-b5ff-2e3c8d17199f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:51.629930 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7ef506c-7278-4d78-b5ff-2e3c8d17199f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:51.630354 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7ef506c-7278-4d78-b5ff-2e3c8d17199f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:51.631028 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7ef506c-7278-4d78-b5ff-2e3c8d17199f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:51.631489 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7ef506c-7278-4d78-b5ff-2e3c8d17199f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:51.631904 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7ef506c-7278-4d78-b5ff-2e3c8d17199f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:51.709578 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f7ef506c-7278-4d78-b5ff-2e3c8d17199f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090566 Sep 02 09:09:51.710165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 78/198] 10.222.0.36 () {58 vars in 1275 bytes} [Fri Sep 2 09:09:51 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:09:52.082435 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:52.083113 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:52.100797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:52.101298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:52.101730 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:52.102435 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:52.102887 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:52.103337 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:52.538003 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:52.546860 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-822f72f4-a745-4a59-a2c3-efa898288415 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.468978 Sep 02 09:09:52.553652 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 121/199] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:52 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:52.595737 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:52.596921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:52.604221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:52.605130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:52.605723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:52.607171 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:52.607774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:52.608618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:52.884158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:52.892733 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1178a9f1-fa45-4529-abc5-7e05a0f26277 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.302821 Sep 02 09:09:52.893394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 79/200] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:52 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:53.574354 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:53.575203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:53.585029 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:53.586799 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:53.590598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:53.591199 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:53.592014 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:53.595266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:53.595929 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:53.630948 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-5a4bdac9-2f9c-4d7e-b0eb-b3712bc469ad req-267b6f09-bc93-4868-9ef2-c940c4a53252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d27c557-5d34-45da-93ea-f6c2a86a807e", "tag": "9b0d7846-3d45-4ced-b88d-87787c99ba4a"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:53.644076 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5a4bdac9-2f9c-4d7e-b0eb-b3712bc469ad req-267b6f09-bc93-4868-9ef2-c940c4a53252 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:53.644609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5a4bdac9-2f9c-4d7e-b0eb-b3712bc469ad req-267b6f09-bc93-4868-9ef2-c940c4a53252 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:53.645051 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5a4bdac9-2f9c-4d7e-b0eb-b3712bc469ad req-267b6f09-bc93-4868-9ef2-c940c4a53252 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:53.658410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-5a4bdac9-2f9c-4d7e-b0eb-b3712bc469ad req-267b6f09-bc93-4868-9ef2-c940c4a53252 service nova] Creating event network-changed:9b0d7846-3d45-4ced-b88d-87787c99ba4a for instance 6d27c557-5d34-45da-93ea-f6c2a86a807e on hv-cinder-85535 Sep 02 09:09:53.664395 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-5a4bdac9-2f9c-4d7e-b0eb-b3712bc469ad req-267b6f09-bc93-4868-9ef2-c940c4a53252 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039596 Sep 02 09:09:53.665071 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 80/201] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:09:53.780572 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:53.789929 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-266fbece-4125-48f5-890b-dd04ac3c0df3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.220333 Sep 02 09:09:53.791426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 122/202] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:53 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:53.915063 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:53.915949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:53.929097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:53.929729 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:53.930387 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:53.931362 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:53.932022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:53.932695 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:53.957139 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:54.070910 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:54.078699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d4c69887-8f93-4b80-8190-a7d43c3e5770 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.168063 Sep 02 09:09:54.079299 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 81/203] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:53 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:54.719465 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-329394641", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "networks": [{"uuid": "b2fc83b2-e41d-430a-a7f9-69f59c0aead7"}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:09:54.772908 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] validate_networks() for [('b2fc83b2-e41d-430a-a7f9-69f59c0aead7', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:09:54.812799 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:54.814496 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:54.821234 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:54.821936 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:54.822374 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:54.823347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:54.823808 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:54.824229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:55.036592 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:55.044945 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aeedcfc6-01c9-488f-8cee-83343f4935c7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.236326 Sep 02 09:09:55.045829 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 82/204] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:54 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:55.100055 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:55.100999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:55.107139 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:55.107738 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:55.108255 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:55.109009 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:55.109465 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:55.109882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:55.487958 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:09:55.488406 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:09:55.488872 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:09:55.489275 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:09:55.489678 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:09:55.498192 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:55.498666 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:55.499120 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:55.499834 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:55.500285 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:55.500698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:55.508181 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:09:55.509960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:55.517581 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-badd7cbd-cf0d-4fbd-84de-bb3613d919ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.421782 Sep 02 09:09:55.518143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 83/205] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:55 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:55.525061 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Getting quotas for project d1883a19a6d24b36a063a5e673495a51. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:09:55.529310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Getting quotas for user 66133313929d4c0f98ab21b1ea336456 and project d1883a19a6d24b36a063a5e673495a51. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:09:55.540482 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:09:55.542748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:09:55.587295 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5443daa3-99f1-4461-9577-e89c58a3ec05 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871913 Sep 02 09:09:55.587930 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 123/206] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:09:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:09:55.599184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba015f95-78c3-46b4-95ff-c6cc83676e8a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:55.599833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ba015f95-78c3-46b4-95ff-c6cc83676e8a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:55.654384 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ba015f95-78c3-46b4-95ff-c6cc83676e8a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:55.661188 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ba015f95-78c3-46b4-95ff-c6cc83676e8a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1213 microversion: 2.1 time: 0.066575 Sep 02 09:09:55.661787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 84/207] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:55 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:56.065940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:56.066555 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:56.072838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:56.073319 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:56.073755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:56.074439 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:56.074893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:56.075354 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:56.204325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:56.211901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4598544e-59d1-4d8d-ae73-3f05bfaaf6c9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.149884 Sep 02 09:09:56.212466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 124/208] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:56 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:56.539410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:56.540017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:56.546230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:56.546703 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:56.547161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:56.547840 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:56.548362 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:56.548780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:56.672260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:56.679717 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-178b0777-ca8f-4dd1-af18-24f20a4e970d tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.144290 Sep 02 09:09:56.680272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 85/209] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:56 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:56.681522 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:56.682258 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:56.688136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:56.688614 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:56.689042 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:56.689724 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:56.690176 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:56.690598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:56.748439 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:56.756491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ca024091-b56f-4f72-84d3-50fc91182660 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1217 microversion: 2.1 time: 0.078696 Sep 02 09:09:56.757051 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 125/210] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:56 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:57.233149 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:57.233682 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:57.240095 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:57.240575 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:57.241005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:57.241689 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:57.242143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:57.242567 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:57.370800 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:57.378542 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-852c250c-02cd-4372-a122-1ff93c7a963c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.149315 Sep 02 09:09:57.379663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 86/211] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:57 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:57.701145 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:57.702078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:57.709233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:57.709718 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:57.710226 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:57.710980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:57.711544 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:57.711971 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:57.777487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:57.778092 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:57.785110 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:57.785514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:57.785992 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:57.786642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:57.787302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:57.787755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:57.859661 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:57.867505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:57.867727 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-77014ed3-a9b8-4b37-b25d-801a5cb73f39 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1217 microversion: 2.1 time: 0.094131 Sep 02 09:09:57.868296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 87/212] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:57 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:57.875400 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eeaa7244-50b0-4767-bcc6-4ff7c8d49cda tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.178961 Sep 02 09:09:57.876083 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 126/213] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:57 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:58.399669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:58.400287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:58.406508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:58.407095 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:58.407585 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:58.408306 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:58.408788 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:58.409212 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:58.541359 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:58.548797 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fd1df365-9c07-454e-943e-6ec1ac915259 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.153090 Sep 02 09:09:58.549354 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 88/214] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:58 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:58.888007 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:58.888648 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:58.894579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:58.895215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:58.895502 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:58.895902 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:58.896111 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:58.896340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:58.896787 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:58.897204 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:58.902281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:58.902755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:58.903216 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:58.903898 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:58.904352 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:58.904768 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:58.977973 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:58.987265 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-79fe2327-d2eb-46db-8399-216bf781ecfa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1217 microversion: 2.1 time: 0.102929 Sep 02 09:09:58.996565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 127/215] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:58 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:09:59.047268 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:59.055490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3fe95cf0-690f-4486-9c98-f45860cc2363 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.163729 Sep 02 09:09:59.056048 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 89/216] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:58 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:09:59.569549 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:09:59.570163 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:09:59.577677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:59.578286 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:59.579342 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:59.580133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:09:59.580718 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:09:59.581395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:09:59.729875 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:09:59.741214 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f1b04409-a5ea-4939-a33c-e6df788df642 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.175304 Sep 02 09:09:59.755893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 128/217] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:09:59 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:00.009296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:00.010469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:00.022258 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.027394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.029553 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.030573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.033512 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.034175 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.077870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:00.079762 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:00.091597 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.092312 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.092980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.093915 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.095170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.095894 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.153231 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:00.166720 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-638a3c65-7273-4a4d-b604-7ddf966f3bf5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1265 microversion: 2.1 time: 0.163315 Sep 02 09:10:00.167978 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 90/218] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:00 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:00.217965 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:00.218820 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:00.226121 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.226612 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.227418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.228285 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.228893 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.229487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.265178 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:10:00.348565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:00.361190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-082645e1-a8e8-40e5-9d0f-dc9adade0e18 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.288779 Sep 02 09:10:00.376326 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 129/219] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:00 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:00.383421 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aad68f72-a5d6-45d4-8fa5-6193c4fa0935 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "DELETE /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 204 len: 0 microversion: 2.1 time: 0.169243 Sep 02 09:10:00.384003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 91/220] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:10:00 2022] DELETE /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 09:10:00.392121 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:00.392734 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:00.399452 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.399943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.400375 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.401069 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.401524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.401947 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.531394 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:00.540230 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c20983f-1a17-46f8-8681-a423867f971c tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1553 microversion: 2.1 time: 0.151863 Sep 02 09:10:00.540825 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 130/221] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:00 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:00.767018 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:00.767785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:00.774696 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.775237 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.775696 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.776317 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:00.776772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:00.777196 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:00.913421 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:00.922184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-18282859-0ce2-4fd5-a094-26a1ba1fa35d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.159912 Sep 02 09:10:00.923356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 92/222] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:00 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:01.188595 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:01.189255 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:01.195229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:01.195717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:01.196275 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:01.196883 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:01.197332 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:01.198049 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:01.265525 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:01.274306 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2ae5931d-44d7-4928-b4f5-729e17a79735 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1265 microversion: 2.1 time: 0.089505 Sep 02 09:10:01.275242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 131/223] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:01 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:01.382138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:01.382749 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:01.389240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:01.389729 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:01.390161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:01.390849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:01.391933 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:01.392365 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:01.561740 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:01.562686 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:01.566349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:01.569076 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:01.569557 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:01.570143 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:01.570833 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:01.571466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:01.571889 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:01.578302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-250afdb1-4577-4e77-a2c2-4077271c9aa4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.199852 Sep 02 09:10:01.580005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 93/224] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:01 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:01.725414 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:01.735585 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3e5a47fd-8638-45e2-95e1-c1b4e676eb85 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1553 microversion: 2.1 time: 0.176984 Sep 02 09:10:01.736698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 132/225] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:01 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:01.751626 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-cc59139d-bb15-4f5c-8b2a-6efce7762691 req-454b7a95-29e3-4396-847f-e64d25b0913d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7331a63-41b1-44e3-8eec-2498b8817212", "name": "network-vif-plugged", "status": "completed", "tag": "6e50eb45-f687-438f-abeb-4bd6303fc38b"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:01.757821 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cc59139d-bb15-4f5c-8b2a-6efce7762691 req-454b7a95-29e3-4396-847f-e64d25b0913d service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:01.758331 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cc59139d-bb15-4f5c-8b2a-6efce7762691 req-454b7a95-29e3-4396-847f-e64d25b0913d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:01.758759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cc59139d-bb15-4f5c-8b2a-6efce7762691 req-454b7a95-29e3-4396-847f-e64d25b0913d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:01.771685 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-cc59139d-bb15-4f5c-8b2a-6efce7762691 req-454b7a95-29e3-4396-847f-e64d25b0913d service nova] Creating event network-vif-plugged:6e50eb45-f687-438f-abeb-4bd6303fc38b for instance e7331a63-41b1-44e3-8eec-2498b8817212 on hv-cinder-85535 Sep 02 09:10:01.777195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-cc59139d-bb15-4f5c-8b2a-6efce7762691 req-454b7a95-29e3-4396-847f-e64d25b0913d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033225 Sep 02 09:10:01.777806 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 94/226] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:01.943656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:01.944271 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:01.950304 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:01.950783 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:01.951246 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:01.951934 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:01.952390 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:01.952811 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:02.093396 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:02.102329 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-54fcbef9-c098-41f2-9879-47122c42caa8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.162587 Sep 02 09:10:02.102933 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 133/227] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:01 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:02.296804 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:02.297508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:02.304017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:02.304496 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:02.304979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:02.305606 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:02.306056 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:02.306474 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:02.386720 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:02.397963 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-99703a6f-6f35-4b2c-b5cf-aa4ab6608902 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1265 microversion: 2.1 time: 0.105406 Sep 02 09:10:02.398527 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 95/228] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:02 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:02.599546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:02.600232 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:02.606106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:02.606580 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:02.607005 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:02.607710 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:02.608156 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:02.608569 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:02.747797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:02.755535 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-064e094a-3cf8-4194-ad94-96ce5c210824 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.159795 Sep 02 09:10:02.756093 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 134/229] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:02 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:02.763239 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:02.764127 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:02.770744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:02.771359 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:02.771894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:02.772698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:02.773252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:02.773867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:02.903999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:02.912439 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6e73fb96-f81b-4240-9a2c-ea333f88da00 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1553 microversion: 2.1 time: 0.152929 Sep 02 09:10:02.913000 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 96/230] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:02 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:03.124172 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:03.124549 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:03.130781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:03.131367 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:03.131810 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:03.132514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:03.132976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:03.133401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:03.308859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:03.326022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-48bb583c-39aa-4dd8-b6cd-6894d104ce7d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.205834 Sep 02 09:10:03.330037 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 135/231] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:03 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:03.419147 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:03.419759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:03.425781 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:03.426279 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:03.426690 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:03.427414 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:03.427862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:03.428282 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:03.504699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:03.506985 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:03.514666 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-90d793c2-0fd3-454c-854a-71e41d450df5 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1273 microversion: 2.1 time: 0.099240 Sep 02 09:10:03.515279 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 97/232] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:03 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:03.776122 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:03.776738 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:03.783136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:03.783628 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:03.784063 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:03.784761 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:03.785213 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:03.785637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:03.934864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:03.935798 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:03.945706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:03.947312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:03.948198 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:03.949900 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:03.950790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:03.951474 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:03.979939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:03.987969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4d51d84f-ff52-4af8-ab6f-3d520d68b808 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1319 microversion: 2.1 time: 0.215726 Sep 02 09:10:03.988838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 136/233] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:03 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:04.089856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:04.098114 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e8a781d0-89a9-42f1-90e2-fe0af5b2cdc8 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1553 microversion: 2.1 time: 0.168244 Sep 02 09:10:04.098624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 98/234] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:03 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:04.350701 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:04.351353 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:04.358623 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:04.359142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:04.360008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:04.361054 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:04.361516 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:04.361940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:04.536657 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:04.537864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:04.544094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:04.544703 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:04.545202 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:04.545957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:04.546554 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:04.547179 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:04.632469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:04.640913 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8cd8ba10-57ce-4bb0-982a-873992837c32 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1271 microversion: 2.1 time: 0.107928 Sep 02 09:10:04.641539 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 99/235] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:04 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:04.668346 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:04.677786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9a23981b-4026-40fd-ba81-b27dd0661e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.330867 Sep 02 09:10:04.678468 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 137/236] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:04 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:04.992014 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-b7eef3e9-74ae-41d8-968f-cb3a8a12521c req-7ac2b7d1-e342-4398-ac55-8a3b2a9a5348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e1961-dfb1-4260-b988-f6805f4d902f", "name": "network-vif-deleted", "tag": "9b530bd8-db0e-487e-90cd-e4bdff16812e"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:05.002310 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b7eef3e9-74ae-41d8-968f-cb3a8a12521c req-7ac2b7d1-e342-4398-ac55-8a3b2a9a5348 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:05.002793 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b7eef3e9-74ae-41d8-968f-cb3a8a12521c req-7ac2b7d1-e342-4398-ac55-8a3b2a9a5348 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:05.003463 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b7eef3e9-74ae-41d8-968f-cb3a8a12521c req-7ac2b7d1-e342-4398-ac55-8a3b2a9a5348 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:05.008554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:05.009237 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:05.015892 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:05.016098 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-b7eef3e9-74ae-41d8-968f-cb3a8a12521c req-7ac2b7d1-e342-4398-ac55-8a3b2a9a5348 service nova] Creating event network-vif-deleted:9b530bd8-db0e-487e-90cd-e4bdff16812e for instance 807e1961-dfb1-4260-b988-f6805f4d902f on hv-cinder-85535 Sep 02 09:10:05.016542 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:05.017035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:05.017954 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:05.018472 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:05.018978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:05.021226 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-b7eef3e9-74ae-41d8-968f-cb3a8a12521c req-7ac2b7d1-e342-4398-ac55-8a3b2a9a5348 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Sep 02 09:10:05.022001 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 100/237] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:05.121073 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:05.122636 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:05.129133 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:05.129634 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:05.130071 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:05.130994 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:05.131703 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:05.132395 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:05.154850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:05.163295 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3b26154b-fe9e-4b93-9b28-67f2d9641024 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1507 microversion: 2.1 time: 0.158575 Sep 02 09:10:05.175219 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 138/238] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:05 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:05.204547 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:05.220986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-124ca7e7-d693-4ff1-b0cd-9f8c6825e2fd tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1511 microversion: 2.1 time: 0.104286 Sep 02 09:10:05.222146 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 101/239] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:05 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1511 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:05.664011 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:05.664679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:05.666440 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:05.667671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:05.675018 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:05.675793 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:05.676642 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:05.677663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:05.678298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:05.678937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:05.699726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:05.701046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:05.709448 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:05.711460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:05.715195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:05.715797 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:05.716575 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:05.723453 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:05.723907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:05.892804 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:05.900906 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-926697f8-6a1c-4fde-8a42-3bc8e9fd27e0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1313 microversion: 2.1 time: 0.240722 Sep 02 09:10:05.906531 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:05.914796 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 139/240] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:05 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:05.916110 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a32f9788-5eeb-49df-bc84-557f4912b488 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.220380 Sep 02 09:10:05.916829 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 102/241] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:05 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:06.092983 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c7e2de11-b5aa-4909-81d9-07bf0d156607 req-7d71dbcb-0d29-4fc0-9889-d8985deb14a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e80bcf-e15a-4abd-91f5-979f790e6c78", "tag": "ffa19756-34db-486e-9f44-b50612515d52"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:06.114864 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c7e2de11-b5aa-4909-81d9-07bf0d156607 req-7d71dbcb-0d29-4fc0-9889-d8985deb14a5 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:06.115375 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c7e2de11-b5aa-4909-81d9-07bf0d156607 req-7d71dbcb-0d29-4fc0-9889-d8985deb14a5 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:06.116017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c7e2de11-b5aa-4909-81d9-07bf0d156607 req-7d71dbcb-0d29-4fc0-9889-d8985deb14a5 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:06.243772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:06.244395 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:06.251367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:06.251754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:06.252324 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:06.253028 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:06.253478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:06.254158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:06.276635 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c7e2de11-b5aa-4909-81d9-07bf0d156607 req-7d71dbcb-0d29-4fc0-9889-d8985deb14a5 service nova] Creating event network-changed:ffa19756-34db-486e-9f44-b50612515d52 for instance d8e80bcf-e15a-4abd-91f5-979f790e6c78 on hv-cinder-85535 Sep 02 09:10:06.282042 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c7e2de11-b5aa-4909-81d9-07bf0d156607 req-7d71dbcb-0d29-4fc0-9889-d8985deb14a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194337 Sep 02 09:10:06.282637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 140/242] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:06.299048 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:06.299752 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:06.300368 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:06.301475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lazy-loading 'fault' on Instance uuid 807e1961-dfb1-4260-b988-f6805f4d902f {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:10:06.374312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:06.388470 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e6ee251a-5af1-4261-bd54-27266992fef1 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1351 microversion: 2.1 time: 0.148406 Sep 02 09:10:06.389128 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 103/243] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:06 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:06.921790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:06.923010 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:06.929041 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:06.929537 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:06.929947 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:06.930626 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:06.931103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:06.931524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:06.936995 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:06.937468 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:06.938051 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:06.944524 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:06.945020 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:06.945450 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:06.946132 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:06.946580 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:06.947001 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:07.137899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:07.145483 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf5ec265-1475-45b0-acf3-5018155d3191 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1313 microversion: 2.1 time: 0.227813 Sep 02 09:10:07.146042 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 141/244] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:06 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:07.149361 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:07.157937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d1b51abb-ece5-4a32-9733-86ea62f758a6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.224308 Sep 02 09:10:07.158510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 104/245] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:06 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:07.410613 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:07.411340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:07.417183 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:07.417669 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:07.418088 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:07.418771 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:07.419258 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:07.419683 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:07.450611 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:07.451110 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:07.451546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:07.451978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lazy-loading 'fault' on Instance uuid 807e1961-dfb1-4260-b988-f6805f4d902f {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:10:07.495382 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adaaf8d979d4cf28456812f9dcfa809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebe6b70a4374511b388d20265e4ccdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:07.503411 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eaa3d9c7-ed3d-477c-86bd-4a688f53faad tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 200 len: 1351 microversion: 2.1 time: 0.097507 Sep 02 09:10:07.503970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 142/246] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:07 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:08.166172 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:08.166807 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:08.174221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:08.174725 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:08.175148 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:08.175838 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:08.176286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:08.176706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:08.178327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:08.178944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:08.185951 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:08.186444 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:08.186968 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:08.187681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:08.188079 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:08.188489 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:08.389767 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:08.393108 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:08.399724 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-70902eff-e9d8-47f7-8e29-b633859dfa26 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1313 microversion: 2.1 time: 0.237313 Sep 02 09:10:08.401000 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f19c56b3-f6d4-4bfd-a05d-6a3d24dac420 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.226439 Sep 02 09:10:08.401608 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 143/247] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:08 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:08.414139 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 105/248] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:08 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:08.523645 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:08.524232 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:08.531179 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:08.532647 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:08.533250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:08.534666 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:08.535149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:08.535600 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:08.550340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] HTTP exception thrown: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Request method failure captured: Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f HTTP/1.1 Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgftMoHRaHlomV0oaA4VZqoTrM1-Ir_9aEkDgBtCGcRmvlmGJi81UGabfhtB5Nvrqg9MiPhOOvqwWdOHccY_p71hbQrsonB5ssBlDAd35gsFXW41_VVJ5FThk1myGpiPkf6ScxTYy7PlyVJ7Up5SNFVVVo4wv5QSZ11LQf6PVEargA Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 8ebe6b70a4374511b388d20265e4ccdf Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:10:08.555673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ebe6b70a4374511b388d20265e4ccdf", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 8ebe6b70a4374511b388d20265e4ccdf Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-DeleteServersTestJSON-156991059-project Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 3adaaf8d979d4cf28456812f9dcfa809 Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-DeleteServersTestJSON-156991059-project Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.556969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '807e1961-dfb1-4260-b988-f6805f4d902f'} Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:08.558563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.560102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.561485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Returning 404 to user: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:08.561485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-52dfc113-fc28-4805-af7e-7fb32c6a3757 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 404 len: 111 microversion: 2.1 time: 0.037380 Sep 02 09:10:08.561485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 144/249] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:08 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:10:08.676897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:08.679513 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:08.685643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:08.686210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:08.686721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:08.687517 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:08.688048 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:08.689104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:08.708691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] HTTP exception thrown: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Request method failure captured: Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f/os-volume_attachments HTTP/1.1 Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgftMoHRaHlomV0oaA4VZqoTrM1-Ir_9aEkDgBtCGcRmvlmGJi81UGabfhtB5Nvrqg9MiPhOOvqwWdOHccY_p71hbQrsonB5ssBlDAd35gsFXW41_VVJ5FThk1myGpiPkf6ScxTYy7PlyVJ7Up5SNFVVVo4wv5QSZ11LQf6PVEargA Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 8ebe6b70a4374511b388d20265e4ccdf Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:10:08.713618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ebe6b70a4374511b388d20265e4ccdf", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 8ebe6b70a4374511b388d20265e4ccdf Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-DeleteServersTestJSON-156991059-project Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 3adaaf8d979d4cf28456812f9dcfa809 Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-DeleteServersTestJSON-156991059-project Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.715102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'server_id': '807e1961-dfb1-4260-b988-f6805f4d902f'} Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:08.715919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:08.716999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:08.718096 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Returning 404 to user: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:08.718096 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-02bc7d6c-9246-443d-8dc0-13323fac4fd3 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043253 Sep 02 09:10:08.718096 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 106/250] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:10:08 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:10:09.422294 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:09.422896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:09.423477 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:09.423579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:09.429249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:09.429464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:09.429732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:09.429949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:09.430165 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:09.430380 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:09.431082 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:09.431250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:09.431535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:09.431712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:09.431953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:09.432139 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:09.634195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:09.635688 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:09.643790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-da42b0a1-3abe-4b44-838b-9cf96544afd9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1313 microversion: 2.1 time: 0.225592 Sep 02 09:10:09.645444 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 145/251] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:09 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:09.646024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f4c5163a-b5af-4a55-a197-a37994b2dd22 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.227473 Sep 02 09:10:09.646616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 107/252] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:09 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:09.935865 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:09.936352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:09.942803 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:09.943316 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:09.943743 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:09.944415 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:09.944863 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:09.945276 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:09.958283 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] HTTP exception thrown: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Request method failure captured: Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f HTTP/1.1 Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgftMoHRaHlomV0oaA4VZqoTrM1-Ir_9aEkDgBtCGcRmvlmGJi81UGabfhtB5Nvrqg9MiPhOOvqwWdOHccY_p71hbQrsonB5ssBlDAd35gsFXW41_VVJ5FThk1myGpiPkf6ScxTYy7PlyVJ7Up5SNFVVVo4wv5QSZ11LQf6PVEargA Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 8ebe6b70a4374511b388d20265e4ccdf Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:10:09.959841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ebe6b70a4374511b388d20265e4ccdf", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 8ebe6b70a4374511b388d20265e4ccdf Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-DeleteServersTestJSON-156991059-project Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 3adaaf8d979d4cf28456812f9dcfa809 Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-DeleteServersTestJSON-156991059-project Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.961281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '807e1961-dfb1-4260-b988-f6805f4d902f'} Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:09.962017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.963222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:09.964314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Returning 404 to user: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:09.964314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-17bfe948-231a-4fbe-bf00-fc320a80f03e tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "DELETE /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 404 len: 111 microversion: 2.1 time: 0.029085 Sep 02 09:10:09.964314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 146/253] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:10:09 2022] DELETE /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:10:09.969445 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:09.970062 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] [instance: 807e1961-dfb1-4260-b988-f6805f4d902f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:09.971887 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:09.977136 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:09.977890 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:09.978328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:09.979017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:09.979509 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:09.979935 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:09.994343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] HTTP exception thrown: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Request method failure captured: Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f HTTP/1.1 Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgftMoHRaHlomV0oaA4VZqoTrM1-Ir_9aEkDgBtCGcRmvlmGJi81UGabfhtB5Nvrqg9MiPhOOvqwWdOHccY_p71hbQrsonB5ssBlDAd35gsFXW41_VVJ5FThk1myGpiPkf6ScxTYy7PlyVJ7Up5SNFVVVo4wv5QSZ11LQf6PVEargA Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 8ebe6b70a4374511b388d20265e4ccdf Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:10:09.996491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ebe6b70a4374511b388d20265e4ccdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ebe6b70a4374511b388d20265e4ccdf", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 8ebe6b70a4374511b388d20265e4ccdf Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-DeleteServersTestJSON-156991059 Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-DeleteServersTestJSON-156991059-project Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 3adaaf8d979d4cf28456812f9dcfa809 Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-DeleteServersTestJSON-156991059-project Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.997836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '807e1961-dfb1-4260-b988-f6805f4d902f'} Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:09.998479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. Sep 02 09:10:09.999732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:10.001461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] Returning 404 to user: Instance 807e1961-dfb1-4260-b988-f6805f4d902f could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:10.001461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-55255b91-4a05-444b-b451-1508133ca108 tempest-DeleteServersTestJSON-156991059 tempest-DeleteServersTestJSON-156991059-project] 10.222.0.36 "GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f" status: 404 len: 111 microversion: 2.1 time: 0.032200 Sep 02 09:10:10.001461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 108/254] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:09 2022] GET /compute/v2.1/servers/807e1961-dfb1-4260-b988-f6805f4d902f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:10:10.664874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:10.666221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:10.667331 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:10.668022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:10.673613 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:10.674340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:10.674773 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:10.675378 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:10.675499 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:10.676008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:10.676129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:10.676451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:10.676566 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:10.686282 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:10.686826 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:10.687351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:11.013747 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:11.026518 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e25d1382-2f5d-454e-80cb-1737c829d505 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.363315 Sep 02 09:10:11.027173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 109/255] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:10 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:11.046370 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:11.054645 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5b79e9ca-2235-4c57-b82a-5c5e65f3fe90 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1313 microversion: 2.1 time: 0.393550 Sep 02 09:10:11.055368 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 147/256] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:10 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:11.739596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-4973e6cf-d4b3-4368-b126-dbd20f4f99a7 req-379c5d0a-a76b-4bc7-b3e5-88e1f34e27bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e80bcf-e15a-4abd-91f5-979f790e6c78", "name": "network-vif-plugged", "status": "completed", "tag": "ffa19756-34db-486e-9f44-b50612515d52"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:11.753918 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-4973e6cf-d4b3-4368-b126-dbd20f4f99a7 req-379c5d0a-a76b-4bc7-b3e5-88e1f34e27bc service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:11.754914 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-4973e6cf-d4b3-4368-b126-dbd20f4f99a7 req-379c5d0a-a76b-4bc7-b3e5-88e1f34e27bc service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:11.755416 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-4973e6cf-d4b3-4368-b126-dbd20f4f99a7 req-379c5d0a-a76b-4bc7-b3e5-88e1f34e27bc service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:11.768623 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-4973e6cf-d4b3-4368-b126-dbd20f4f99a7 req-379c5d0a-a76b-4bc7-b3e5-88e1f34e27bc service nova] Creating event network-vif-plugged:ffa19756-34db-486e-9f44-b50612515d52 for instance d8e80bcf-e15a-4abd-91f5-979f790e6c78 on hv-cinder-85535 Sep 02 09:10:11.773437 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-4973e6cf-d4b3-4368-b126-dbd20f4f99a7 req-379c5d0a-a76b-4bc7-b3e5-88e1f34e27bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038368 Sep 02 09:10:11.774229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 110/257] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:12.049032 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:12.049918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:12.056648 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:12.057139 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:12.057784 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:12.058658 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:12.059157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:12.059603 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:12.076831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:12.077873 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:12.086129 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:12.086917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:12.087640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:12.088605 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:12.089935 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:12.090525 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:12.429413 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:12.437578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bf40ae8d-b724-4b56-b929-cf94ad1c4265 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.393458 Sep 02 09:10:12.439981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:12.448487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-101f5912-4d47-4412-8b7f-790e3fe44d3d tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1313 microversion: 2.1 time: 0.376100 Sep 02 09:10:12.449442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 111/258] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:12 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:12.451359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 148/259] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:12 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:13.458163 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:13.458811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:13.471842 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:13.472749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:13.477220 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:13.480086 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:13.482057 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:13.482699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:13.483741 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:13.484295 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:13.484849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:13.486004 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:13.491870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:13.493197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:13.493912 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:13.494604 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:13.852621 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:13.863055 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b75c7b44-35e7-4ba1-b1b9-7ee6c6b15079 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.408987 Sep 02 09:10:13.864302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 112/260] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:13 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:13.872771 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:13.882443 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-895be70f-33c8-4e9f-82ae-5cbab78e8de2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1313 microversion: 2.1 time: 0.414969 Sep 02 09:10:13.883565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 149/261] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:13 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:14.884415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:14.885021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:14.891919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:14.892425 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:14.892853 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:14.893538 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:14.893984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:14.894403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:14.904316 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:14.904926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:14.910886 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:14.911405 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:14.912078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:14.915755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:14.916239 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:14.916662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:15.122089 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:15.128041 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:15.136941 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-edfb1caa-1429-4c75-b902-5e5c91b4aad0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1496 microversion: 2.1 time: 0.235979 Sep 02 09:10:15.137842 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7275a5f6-085a-4495-ab7f-af2a72418623 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.257085 Sep 02 09:10:15.138212 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 150/262] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:14 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1496 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:15.138665 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 113/263] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:14 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:15.571700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1578599c-4c33-4b98-bb85-d912d9d09a04 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Action: 'create', calling method: .version_select at 0x7f54bc602550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-794895156"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:15.850153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:15.850974 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:15.856791 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:15.857679 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:15.858546 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:15.859277 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:15.859727 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:15.860741 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:15.870993 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1578599c-4c33-4b98-bb85-d912d9d09a04 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.451869 Sep 02 09:10:15.871654 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 151/264] 10.222.0.36 () {60 vars in 1155 bytes} [Fri Sep 2 09:10:15 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 453 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 09:10:15.886402 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-427c7579-8aac-4d0d-af11-a7708460b3e2 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc5ff1f0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:15.941678 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-427c7579-8aac-4d0d-af11-a7708460b3e2 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6" status: 200 len: 344 microversion: 2.1 time: 0.059508 Sep 02 09:10:15.942306 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 152/265] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:10:15 2022] GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:10:16.029098 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:10:16.112087 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9a6ae513-51dd-45aa-9159-954c081a4afa tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 204 len: 0 microversion: 2.1 time: 0.265362 Sep 02 09:10:16.112805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 114/266] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:10:15 2022] DELETE /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 09:10:16.121299 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:16.121649 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:16.129413 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:16.129900 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:16.130332 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:16.131029 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:16.131524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:16.131947 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:16.159494 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:16.160194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:16.166074 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:16.166559 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:16.166993 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:16.167707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:16.168193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:16.168611 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:16.173221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:16.321953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:16.329759 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d618d625-3c1b-4bf1-898e-b7a96f430cd6 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1502 microversion: 2.1 time: 0.212708 Sep 02 09:10:16.330324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 153/267] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:16 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:16.343812 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:16.352052 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-342c775b-e6ad-4b37-aefd-30230bb1ad06 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.196911 Sep 02 09:10:16.352614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 115/268] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:16 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:16.955973 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-35ac24ce-e3f5-4a0e-a5c0-ac0821f5dca5 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc602d30>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:17.001908 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-35ac24ce-e3f5-4a0e-a5c0-ac0821f5dca5 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6" status: 200 len: 345 microversion: 2.1 time: 0.050155 Sep 02 09:10:17.002461 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 154/269] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:10:16 2022] GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:17.014561 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5be2257b-5c0b-4425-a327-8c08b6be13e8 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Action: 'create', calling method: .version_select at 0x7f54bc6ad670>, body: {"snapshot": {"volume_id": "6c8f3de5-0125-495e-8408-3b74daf7e9a6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1967222362"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:17.165805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5be2257b-5c0b-4425-a327-8c08b6be13e8 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.154913 Sep 02 09:10:17.166402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 116/270] 10.222.0.36 () {60 vars in 1162 bytes} [Fri Sep 2 09:10:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:10:17.176982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-525a4080-7e14-4dd6-9b68-721ce3b6fb71 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc8eb5e0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:17.208717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-525a4080-7e14-4dd6-9b68-721ce3b6fb71 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab" status: 200 len: 287 microversion: 2.1 time: 0.035505 Sep 02 09:10:17.209291 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 155/271] 10.222.0.36 () {58 vars in 1251 bytes} [Fri Sep 2 09:10:17 2022] GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:17.220403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-151fd297-5758-4031-8c71-92a9c831f65f tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc741820>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:17.253313 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-151fd297-5758-4031-8c71-92a9c831f65f tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037086 Sep 02 09:10:17.253882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 117/272] 10.222.0.36 () {58 vars in 1140 bytes} [Fri Sep 2 09:10:17 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:17.264439 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-167652cc-53d0-4cc2-9b02-ebb6561a4567 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc656a60>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:17.298437 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-167652cc-53d0-4cc2-9b02-ebb6561a4567 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab" status: 200 len: 287 microversion: 2.1 time: 0.037629 Sep 02 09:10:17.299008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 156/273] 10.222.0.36 () {58 vars in 1251 bytes} [Fri Sep 2 09:10:17 2022] GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:17.349874 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:17.350578 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:17.359248 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:17.359802 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:17.360284 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:17.361047 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:17.361569 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:17.361990 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:17.373328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:17.373939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:17.380913 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:17.381392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:17.381819 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:17.382496 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:17.382943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:17.383467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:17.553356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:17.562590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-086362e8-315a-48ae-8717-32ec70dc6188 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1502 microversion: 2.1 time: 0.216479 Sep 02 09:10:17.564101 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 118/274] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:17 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:17.566461 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:17.574465 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-055bad94-85ec-43ca-8c3f-d98b4140c7b3 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.205181 Sep 02 09:10:17.575000 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 157/275] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:17 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:18.311185 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1068196a-bd47-4a12-a336-4e4934e5ca9f tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc595670>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:18.341642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1068196a-bd47-4a12-a336-4e4934e5ca9f tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab" status: 200 len: 287 microversion: 2.1 time: 0.034275 Sep 02 09:10:18.342210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 119/276] 10.222.0.36 () {58 vars in 1251 bytes} [Fri Sep 2 09:10:18 2022] GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:18.584554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:18.585164 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:18.591348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:18.591837 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:18.592360 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:18.593083 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:18.593561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:18.593983 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:18.595444 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:18.596057 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:18.601949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:18.602427 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:18.602858 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:18.603616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:18.604081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:18.604503 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:18.798751 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:18.801762 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:18.806306 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9b5c8c4a-a1ef-4ee0-b3ba-758b76313b67 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1502 microversion: 2.1 time: 0.225632 Sep 02 09:10:18.806957 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 158/277] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:18 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:18.809469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2bf39890-2baf-4769-bf00-967e53a83fbd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.218399 Sep 02 09:10:18.810024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 120/278] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:18 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:19.357215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c2c97543-a67c-4490-950b-d9d1d7c92d18 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc5ffc10>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:19.386585 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c2c97543-a67c-4490-950b-d9d1d7c92d18 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab" status: 200 len: 287 microversion: 2.1 time: 0.035808 Sep 02 09:10:19.387151 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 159/279] 10.222.0.36 () {58 vars in 1251 bytes} [Fri Sep 2 09:10:19 2022] GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:19.827786 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:19.828400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:19.830125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:19.830736 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:19.835346 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:19.835830 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:19.836264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:19.836532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:19.836949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:19.837042 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:19.837404 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:19.837498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:19.837825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:19.838078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:19.838524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:19.838939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:20.035186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:20.038607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:20.042804 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-215d9ab2-d29f-44dc-a8d1-da7870c832c4 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1502 microversion: 2.1 time: 0.218895 Sep 02 09:10:20.043400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 121/280] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:19 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:20.046409 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-601253b0-ab40-4320-ab94-ce1dfe1fbeed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.220447 Sep 02 09:10:20.047036 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 160/281] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:19 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:20.399161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bf6b601b-46c0-4f6c-9be6-dedf8bd330b3 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc844dc0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:20.428056 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bf6b601b-46c0-4f6c-9be6-dedf8bd330b3 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab" status: 200 len: 287 microversion: 2.1 time: 0.032801 Sep 02 09:10:20.428639 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 122/282] 10.222.0.36 () {58 vars in 1251 bytes} [Fri Sep 2 09:10:20 2022] GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:21.064656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:21.065940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:21.066947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:21.068192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:21.072922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:21.073905 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:21.074349 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:21.075059 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:21.075227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:21.075535 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:21.075811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:21.075953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:21.076257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:21.076964 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:21.077422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:21.077854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:21.269494 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:21.277685 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4acd8938-2952-4dc0-ad62-17ede755a56e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.215907 Sep 02 09:10:21.278519 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:21.287391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-855d9a8c-34ae-424b-9b3c-2ae04f5c95a2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1502 microversion: 2.1 time: 0.227533 Sep 02 09:10:21.288055 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 161/283] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:21 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:21.291613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 123/284] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:21 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:21.441178 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4deb98e2-60ab-49f1-b609-2fcc27c0caf9 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc8eb4c0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:21.471984 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4deb98e2-60ab-49f1-b609-2fcc27c0caf9 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab" status: 200 len: 288 microversion: 2.1 time: 0.035221 Sep 02 09:10:21.472532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 162/285] 10.222.0.36 () {58 vars in 1251 bytes} [Fri Sep 2 09:10:21 2022] GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:21.483394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-97bb4be6-1634-4206-b791-f2dbf875bfa2 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc6c8e50>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:21.540922 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-97bb4be6-1634-4206-b791-f2dbf875bfa2 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab" status: 202 len: 0 microversion: 2.1 time: 0.061340 Sep 02 09:10:21.541491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 124/286] 10.222.0.36 () {58 vars in 1254 bytes} [Fri Sep 2 09:10:21 2022] DELETE /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:10:21.550326 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a611f36d-c113-439c-9deb-83a509ce473e tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc602b80>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:21.583176 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a611f36d-c113-439c-9deb-83a509ce473e tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab" status: 200 len: 287 microversion: 2.1 time: 0.037102 Sep 02 09:10:21.583742 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 163/287] 10.222.0.36 () {58 vars in 1251 bytes} [Fri Sep 2 09:10:21 2022] GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:22.313912 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:22.314624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:22.318397 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:22.319026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:22.321174 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:22.322489 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:22.322991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:22.324109 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:22.324650 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:22.325135 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:22.334545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:22.339592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:22.340256 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:22.343111 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:22.346605 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:22.347585 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:22.446041 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:22.456758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b301eb15-d38b-4981-908f-7c9f54221eec tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1460 microversion: 2.1 time: 0.147342 Sep 02 09:10:22.457334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 164/288] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:22 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1460 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:22.522341 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:22.523449 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c4fae405-6ac2-4437-87f3-1c2f1ca55f2e req-94a12c29-af9d-4fc1-b57c-8adba43b3f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e80bcf-e15a-4abd-91f5-979f790e6c78", "name": "network-vif-deleted", "tag": "ffa19756-34db-486e-9f44-b50612515d52"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:22.532812 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3163f329-ec39-4975-ab97-234fc948a955 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1522 microversion: 2.1 time: 0.223068 Sep 02 09:10:22.533460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 125/289] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:22 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:22.533760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c4fae405-6ac2-4437-87f3-1c2f1ca55f2e req-94a12c29-af9d-4fc1-b57c-8adba43b3f8a service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:22.534307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c4fae405-6ac2-4437-87f3-1c2f1ca55f2e req-94a12c29-af9d-4fc1-b57c-8adba43b3f8a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:22.534738 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c4fae405-6ac2-4437-87f3-1c2f1ca55f2e req-94a12c29-af9d-4fc1-b57c-8adba43b3f8a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:22.546082 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c4fae405-6ac2-4437-87f3-1c2f1ca55f2e req-94a12c29-af9d-4fc1-b57c-8adba43b3f8a service nova] Creating event network-vif-deleted:ffa19756-34db-486e-9f44-b50612515d52 for instance d8e80bcf-e15a-4abd-91f5-979f790e6c78 on hv-cinder-85535 Sep 02 09:10:22.551720 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c4fae405-6ac2-4437-87f3-1c2f1ca55f2e req-94a12c29-af9d-4fc1-b57c-8adba43b3f8a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031725 Sep 02 09:10:22.552297 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 165/290] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:10:22.596264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6fd2a603-a845-4843-bad5-173c5ac8c6ed tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc6c84c0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:22.647906 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-6fd2a603-a845-4843-bad5-173c5ac8c6ed tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] HTTP exception thrown: Snapshot 00689f61-33bd-4626-b727-bdf166cc85ab could not be found. Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6fd2a603-a845-4843-bad5-173c5ac8c6ed tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Request method failure captured: Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab HTTP/1.1 Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEch3PCLeu-MGyyXVrvmJ2yjresEZRHzSvUZy4vqQbYSqlE1jJCxD9AFox8HZMQfYL7O1uPV3blKrklOjEzNNi5RrBr2waAGtDeVTOy-T2rc2aE9N_sdv3hYtVFmlULEQqR_5eyLCMQmpCb4I-D9N_0jeEl3o559x96iK23Hd2DuB94w Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 5e37db690681428f8e47bc6f46b7dbd7 Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:10:22.650678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e37db690681428f8e47bc6f46b7dbd7", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 5e37db690681428f8e47bc6f46b7dbd7 Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotsTestJSON-603730466-project Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: c49c8104d02f4431a94f165206717531 Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotsTestJSON-603730466-project Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Snapshot 00689f61-33bd-4626-b727-bdf166cc85ab could not be found. Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '00689f61-33bd-4626-b727-bdf166cc85ab'} Sep 02 09:10:22.652173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 00689f61-33bd-4626-b727-bdf166cc85ab could not be found. (HTTP 404) (Request-ID: req-bece98dd-f5d5-456d-a478-166cd76df47d) Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:22.653104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:10:22.654320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 00689f61-33bd-4626-b727-bdf166cc85ab could not be found. Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 02 09:10:22.655583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 00689f61-33bd-4626-b727-bdf166cc85ab could not be found. Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 00689f61-33bd-4626-b727-bdf166cc85ab could not be found. Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6fd2a603-a845-4843-bad5-173c5ac8c6ed tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Returning 404 to user: Snapshot 00689f61-33bd-4626-b727-bdf166cc85ab could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6fd2a603-a845-4843-bad5-173c5ac8c6ed tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab" status: 404 len: 111 microversion: 2.1 time: 0.060529 Sep 02 09:10:22.658256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 126/291] 10.222.0.36 () {58 vars in 1251 bytes} [Fri Sep 2 09:10:22 2022] GET /compute/v2.1/os-snapshots/00689f61-33bd-4626-b727-bdf166cc85ab => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:10:22.661689 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dd7e0a79-e0cb-4153-a315-bb6b01911a4e tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc602af0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:22.727344 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dd7e0a79-e0cb-4153-a315-bb6b01911a4e tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6" status: 202 len: 0 microversion: 2.1 time: 0.070190 Sep 02 09:10:22.727902 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 166/292] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:10:22 2022] DELETE /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 09:10:22.736125 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8975d9f3-d64b-4cff-a05d-cd588838db2d tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc58fb80>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:22.790990 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8975d9f3-d64b-4cff-a05d-cd588838db2d tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6" status: 200 len: 344 microversion: 2.1 time: 0.058547 Sep 02 09:10:22.791672 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 127/293] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:10:22 2022] GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:10:23.478398 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:23.479716 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:23.487395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:23.487965 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:23.488572 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:23.489317 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:23.489981 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:23.490560 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:23.522506 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:23.523121 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:23.523637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:23.524148 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lazy-loading 'fault' on Instance uuid d8e80bcf-e15a-4abd-91f5-979f790e6c78 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:10:23.554407 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:23.555024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:23.561508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:23.561997 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:23.562432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:23.563878 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:23.564490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:23.565079 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:23.570421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:23.579830 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-92d744ee-4ea6-4858-91e9-818c83d6d3fd tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 200 len: 1303 microversion: 2.1 time: 0.105382 Sep 02 09:10:23.580388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 167/294] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:23 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:23.717381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:23.725332 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-27afe523-3a5a-4074-a106-8df231cd0f21 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1502 microversion: 2.1 time: 0.175254 Sep 02 09:10:23.725901 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 128/295] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:23 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:23.745578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:23.746277 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:23.748341 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:23.754766 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:23.755559 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:23.755999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:23.756696 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:23.757151 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:23.757579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:23.773830 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:23.805417 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f0c55253-9e35-4951-ae08-c5ca10e28a4e tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc58f700>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:23.833021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-f0c55253-9e35-4951-ae08-c5ca10e28a4e tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] HTTP exception thrown: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f0c55253-9e35-4951-ae08-c5ca10e28a4e tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Request method failure captured: Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 HTTP/1.1 Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEch3PCLeu-MGyyXVrvmJ2yjresEZRHzSvUZy4vqQbYSqlE1jJCxD9AFox8HZMQfYL7O1uPV3blKrklOjEzNNi5RrBr2waAGtDeVTOy-T2rc2aE9N_sdv3hYtVFmlULEQqR_5eyLCMQmpCb4I-D9N_0jeEl3o559x96iK23Hd2DuB94w Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 5e37db690681428f8e47bc6f46b7dbd7 Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:10:23.834960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e37db690681428f8e47bc6f46b7dbd7", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 5e37db690681428f8e47bc6f46b7dbd7 Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotsTestJSON-603730466-project Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: c49c8104d02f4431a94f165206717531 Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotsTestJSON-603730466-project Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '6c8f3de5-0125-495e-8408-3b74daf7e9a6'} Sep 02 09:10:23.836426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. (HTTP 404) (Request-ID: req-fc4e7cb5-9246-4fb2-be6d-70ddece9cca0) Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:23.837290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:10:23.839409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 09:10:23.840745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f0c55253-9e35-4951-ae08-c5ca10e28a4e tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Returning 404 to user: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f0c55253-9e35-4951-ae08-c5ca10e28a4e tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6" status: 404 len: 109 microversion: 2.1 time: 0.035045 Sep 02 09:10:23.841979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 129/296] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:10:23 2022] GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 09:10:23.857798 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1161161f-b55d-41fb-a5a2-80bfc3028696 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc59dc10>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:23.898762 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-1161161f-b55d-41fb-a5a2-80bfc3028696 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] HTTP exception thrown: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1161161f-b55d-41fb-a5a2-80bfc3028696 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Request method failure captured: Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 HTTP/1.1 Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEch3PCLeu-MGyyXVrvmJ2yjresEZRHzSvUZy4vqQbYSqlE1jJCxD9AFox8HZMQfYL7O1uPV3blKrklOjEzNNi5RrBr2waAGtDeVTOy-T2rc2aE9N_sdv3hYtVFmlULEQqR_5eyLCMQmpCb4I-D9N_0jeEl3o559x96iK23Hd2DuB94w Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 5e37db690681428f8e47bc6f46b7dbd7 Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:10:23.900944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e37db690681428f8e47bc6f46b7dbd7", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 5e37db690681428f8e47bc6f46b7dbd7 Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotsTestJSON-603730466-project Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: c49c8104d02f4431a94f165206717531 Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotsTestJSON-603730466-project Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '6c8f3de5-0125-495e-8408-3b74daf7e9a6'} Sep 02 09:10:23.902311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. (HTTP 404) (Request-ID: req-8c1bf1fe-59c2-432f-bb7c-911d76edb6ee) Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:23.903281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 09:10:23.904520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 09:10:23.905744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1161161f-b55d-41fb-a5a2-80bfc3028696 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Returning 404 to user: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1161161f-b55d-41fb-a5a2-80bfc3028696 tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6" status: 404 len: 109 microversion: 2.1 time: 0.048990 Sep 02 09:10:23.907479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 130/297] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:10:23 2022] DELETE /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:10:23.911996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c28fa7c-55aa-4da3-9561-47f8d270435d tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Calling method '.version_select at 0x7f54bc70eca0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:23.943358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-5c28fa7c-55aa-4da3-9561-47f8d270435d tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] HTTP exception thrown: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c28fa7c-55aa-4da3-9561-47f8d270435d tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Request method failure captured: Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 HTTP/1.1 Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEch3PCLeu-MGyyXVrvmJ2yjresEZRHzSvUZy4vqQbYSqlE1jJCxD9AFox8HZMQfYL7O1uPV3blKrklOjEzNNi5RrBr2waAGtDeVTOy-T2rc2aE9N_sdv3hYtVFmlULEQqR_5eyLCMQmpCb4I-D9N_0jeEl3o559x96iK23Hd2DuB94w Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 5e37db690681428f8e47bc6f46b7dbd7 Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:10:23.945545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e37db690681428f8e47bc6f46b7dbd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e37db690681428f8e47bc6f46b7dbd7", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 5e37db690681428f8e47bc6f46b7dbd7 Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-603730466 Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotsTestJSON-603730466-project Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: c49c8104d02f4431a94f165206717531 Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotsTestJSON-603730466-project Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '6c8f3de5-0125-495e-8408-3b74daf7e9a6'} Sep 02 09:10:23.947037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. (HTTP 404) (Request-ID: req-bd6ddac7-0957-478e-9569-600bef72dffb) Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:23.947824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:10:23.949281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 09:10:23.950473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c28fa7c-55aa-4da3-9561-47f8d270435d tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] Returning 404 to user: Volume 6c8f3de5-0125-495e-8408-3b74daf7e9a6 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:23.951721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5c28fa7c-55aa-4da3-9561-47f8d270435d tempest-VolumesSnapshotsTestJSON-603730466 tempest-VolumesSnapshotsTestJSON-603730466-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6" status: 404 len: 109 microversion: 2.1 time: 0.041942 Sep 02 09:10:23.955479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 131/298] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:10:23 2022] GET /compute/v2.1/os-volumes/6c8f3de5-0125-495e-8408-3b74daf7e9a6 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:10:23.961149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:23.970234 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04218695-dfcc-4f67-b0f3-4d38617ebb9c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1516 microversion: 2.1 time: 0.227736 Sep 02 09:10:23.971602 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 168/299] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:23 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:24.603404 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:24.603979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: d8e80bcf-e15a-4abd-91f5-979f790e6c78] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:24.615544 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:24.616233 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:24.616929 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:24.618043 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:24.618508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:24.618948 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:24.634107 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] HTTP exception thrown: Instance d8e80bcf-e15a-4abd-91f5-979f790e6c78 could not be found. Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Request method failure captured: Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 HTTP/1.1 Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEchhtHr6fEt8x9bZnTWO0RhKfHC3BHK1W0M85xJHTf58KQuq-FtMvfJmG7KwOqhn68UxiT6JxgX7DDROVT0bM2pQ03KT5_CnjxBtB_Cluu9PzUIVLbpi2YpAXqOSvl23Wkz8UyvKGOldcx6B4odz0ZQZEvinZA47YVo12ZNDHzGiFPU Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: d1883a19a6d24b36a063a5e673495a51 Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesActionsTest-1566121694 Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:10:24.635693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1883a19a6d24b36a063a5e673495a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1883a19a6d24b36a063a5e673495a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1883a19a6d24b36a063a5e673495a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1883a19a6d24b36a063a5e673495a51", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesActionsTest-1566121694 Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: d1883a19a6d24b36a063a5e673495a51 Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesActionsTest-1566121694 Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesActionsTest-1566121694-project Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 66133313929d4c0f98ab21b1ea336456 Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesActionsTest-1566121694-project Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance d8e80bcf-e15a-4abd-91f5-979f790e6c78 could not be found. Sep 02 09:10:24.636894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': 'd8e80bcf-e15a-4abd-91f5-979f790e6c78'} Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e80bcf-e15a-4abd-91f5-979f790e6c78 could not be found. Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:24.637590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e80bcf-e15a-4abd-91f5-979f790e6c78 could not be found. Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e80bcf-e15a-4abd-91f5-979f790e6c78 could not be found. Sep 02 09:10:24.638691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:10:24.640129 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Returning 404 to user: Instance d8e80bcf-e15a-4abd-91f5-979f790e6c78 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:24.640129 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ba9691f2-ff60-4c6c-9e6b-e4b896396487 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78" status: 404 len: 111 microversion: 2.1 time: 0.039674 Sep 02 09:10:24.640129 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 132/300] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:24 2022] GET /compute/v2.1/servers/d8e80bcf-e15a-4abd-91f5-979f790e6c78 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:10:24.776203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-304264936", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "networks": [{"uuid": "b2fc83b2-e41d-430a-a7f9-69f59c0aead7"}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:24.846023 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] validate_networks() for [('b2fc83b2-e41d-430a-a7f9-69f59c0aead7', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:10:25.248417 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:10:25.248840 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:10:25.249494 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:10:25.249904 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:10:25.250524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:10:25.262323 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:25.263183 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:25.263661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:25.264721 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:25.265421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:25.265919 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:25.289082 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Getting quotas for project d1883a19a6d24b36a063a5e673495a51. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:10:25.293188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Getting quotas for user 66133313929d4c0f98ab21b1ea336456 and project d1883a19a6d24b36a063a5e673495a51. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:10:25.305525 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:10:25.312323 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:10:25.368533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d5bfa101-7d2e-4042-b4e1-c43092454441 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596906 Sep 02 09:10:25.369777 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 169/301] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:10:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 09:10:25.381928 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ca584b45-c6fd-417e-b1d1-62a5739bb6a9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:25.382358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ca584b45-c6fd-417e-b1d1-62a5739bb6a9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:25.458922 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ca584b45-c6fd-417e-b1d1-62a5739bb6a9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:25.465591 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ca584b45-c6fd-417e-b1d1-62a5739bb6a9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1213 microversion: 2.1 time: 0.088501 Sep 02 09:10:25.466162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 133/302] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:25 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:25.494057 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:25.497576 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:25.507260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:25.508217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:25.508651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:25.509350 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:25.510001 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:25.510468 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:25.539684 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lazy-loading 'flavor' on Instance uuid 5d56b84b-6132-4d68-8ead-b4a14070a060 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:10:25.639960 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aba4876e-e3cb-4982-8efb-5060872742db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060/action" status: 200 len: 32 microversion: 2.1 time: 0.152092 Sep 02 09:10:25.646191 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 170/303] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:10:25 2022] POST /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:10:25.651966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:25.653284 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:25.662885 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:25.663778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:25.664152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:25.665451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:25.666165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:25.667383 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:25.879501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:25.893029 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-480cede7-4879-4db2-98b2-a680a9c18553 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.245860 Sep 02 09:10:25.894547 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 134/304] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:25 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:26.501156 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:26.501885 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:26.509121 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:26.509781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:26.510555 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:26.511770 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:26.512417 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:26.513433 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:26.603197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:26.616106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-36c370a4-2c5d-4fc8-80c9-74f183a72ee2 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1265 microversion: 2.1 time: 0.127768 Sep 02 09:10:26.616904 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 171/305] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:26 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:26.913627 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:26.914238 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:26.921506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:26.923532 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:26.924205 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:26.925138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:26.925818 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:26.926387 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:27.111188 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:27.121703 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ce9eb555-8773-4f41-859f-f172f9f3b7b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.211726 Sep 02 09:10:27.122395 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 135/306] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:26 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:27.637881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:27.638507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:27.645416 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:27.645904 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:27.646336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:27.647218 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:27.647678 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:27.648088 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:27.718636 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:27.729466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0ef14989-94fb-40e6-aa26-a56175d40280 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1271 microversion: 2.1 time: 0.095427 Sep 02 09:10:27.730228 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 172/307] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:27 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:28.162655 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:28.164056 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:28.172045 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:28.173348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:28.173785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:28.174653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:28.175207 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:28.175835 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:28.331187 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:28.348039 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-708c8ddf-3e9b-4617-b0e2-5c603c81c788 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.203480 Sep 02 09:10:28.348941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 136/308] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:28 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:28.750068 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:28.750934 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:28.757200 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:28.757895 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:28.758531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:28.759455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:28.760108 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:28.760542 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:28.885323 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-5bcb8c4f-d340-43b0-bdf3-3ecb0832ba0e req-5cc17938-f967-4141-8364-59f5f5063c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab40b56-752e-4b4a-a847-025419beaa1b", "tag": "39ed7331-124d-4623-8faf-66d95a6c6bdf"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:28.906491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5bcb8c4f-d340-43b0-bdf3-3ecb0832ba0e req-5cc17938-f967-4141-8364-59f5f5063c02 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:28.907690 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5bcb8c4f-d340-43b0-bdf3-3ecb0832ba0e req-5cc17938-f967-4141-8364-59f5f5063c02 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:28.908103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:28.908313 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5bcb8c4f-d340-43b0-bdf3-3ecb0832ba0e req-5cc17938-f967-4141-8364-59f5f5063c02 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:28.918946 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-85132c5a-9ad2-45ae-8cb4-62afa78a9cb9 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1313 microversion: 2.1 time: 0.172474 Sep 02 09:10:28.920012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 173/309] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:28 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:28.929232 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-5bcb8c4f-d340-43b0-bdf3-3ecb0832ba0e req-5cc17938-f967-4141-8364-59f5f5063c02 service nova] Creating event network-changed:39ed7331-124d-4623-8faf-66d95a6c6bdf for instance 0ab40b56-752e-4b4a-a847-025419beaa1b on hv-cinder-85535 Sep 02 09:10:28.934803 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-5bcb8c4f-d340-43b0-bdf3-3ecb0832ba0e req-5cc17938-f967-4141-8364-59f5f5063c02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062731 Sep 02 09:10:28.935557 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 137/310] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:29.370754 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:29.371389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:29.377504 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:29.377986 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:29.378625 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:29.379371 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:29.380033 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:29.380888 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:29.528755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:29.537351 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c60317df-adbf-439f-a27d-e5d94a4ae2bb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.171284 Sep 02 09:10:29.537992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 174/311] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:29 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:29.941216 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:29.941929 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:29.948276 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:29.949011 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:29.949451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:29.950152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:29.950609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:29.951031 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:30.096318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1286d4b5-72ca-406a-8189-c886e5e536c0 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09c9210b-eaab-4178-8b82-d50ec9b047f5", "device": "/dev/sdb"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:30.099179 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1286d4b5-72ca-406a-8189-c886e5e536c0 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:30.105868 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1286d4b5-72ca-406a-8189-c886e5e536c0 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:30.106524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1286d4b5-72ca-406a-8189-c886e5e536c0 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:30.107161 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1286d4b5-72ca-406a-8189-c886e5e536c0 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:30.108008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1286d4b5-72ca-406a-8189-c886e5e536c0 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:30.108613 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1286d4b5-72ca-406a-8189-c886e5e536c0 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:30.109187 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1286d4b5-72ca-406a-8189-c886e5e536c0 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:30.126876 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:30.134818 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bba7d303-9d45-4805-81da-22640c2c0c9c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1313 microversion: 2.1 time: 0.199342 Sep 02 09:10:30.135422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 138/312] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:29 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:30.557586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:30.558291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:30.564200 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:30.564741 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:30.565244 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:30.565881 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:30.566339 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:30.566762 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:30.697046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:30.705819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a0273a52-45d9-4943-9e9f-d1c85a2ea454 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.152029 Sep 02 09:10:30.706388 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 139/313] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:30 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:31.156238 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:31.156960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:31.163277 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:31.163746 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:31.164174 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:31.164865 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:31.165318 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:31.165766 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:31.298021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:31.306143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cf3368c1-c3f1-4677-a6d2-aac5053bf942 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1313 microversion: 2.1 time: 0.153872 Sep 02 09:10:31.306807 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 140/314] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:31 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:31.730756 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:31.730756 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:31.736185 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:31.736667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:31.737094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:31.737780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:31.738333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:31.738827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:31.877442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:31.885585 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8941d02e-49d4-47f3-a696-dc4a06f34a16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.160089 Sep 02 09:10:31.886232 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 141/315] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:31 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:32.327724 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:32.329758 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:32.342307 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:32.342873 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:32.343413 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:32.344271 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:32.344731 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:32.345155 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:32.492390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:32.502437 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f3785cc1-a65b-481e-95ff-85eba165501b tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1313 microversion: 2.1 time: 0.178916 Sep 02 09:10:32.503609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 142/316] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:32 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:32.907883 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:32.909092 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:32.917663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:32.918600 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:32.919057 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:32.919871 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:32.920387 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:32.920989 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:33.060093 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:33.068286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5d474db4-815d-4b3c-8502-68c2c1724fce tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.165558 Sep 02 09:10:33.068862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 143/317] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:32 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:10:33.523644 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:33.524379 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:33.534358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:33.534863 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:33.535327 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:33.536231 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:33.536696 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:33.537126 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:33.541650 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:33.645032 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1286d4b5-72ca-406a-8189-c886e5e536c0 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "POST /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.552660 Sep 02 09:10:33.645624 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 175/318] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:10:30 2022] POST /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212/os-volume_attachments => generated 194 bytes in 3554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:10:33.706032 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:33.714616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a7074438-e077-4e5d-b9d5-6c89f4f8ef77 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1313 microversion: 2.1 time: 0.195194 Sep 02 09:10:33.715667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 144/319] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:33 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:34.089962 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:34.090667 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:34.097112 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:34.097619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:34.098055 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:34.098741 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:34.099290 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:34.099714 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:34.236479 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:34.244017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a3c5fd3b-268c-473a-bea7-0e2b0abca6c0 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.158735 Sep 02 09:10:34.244634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 176/320] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:34 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:34.735577 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:34.736313 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:34.742703 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:34.743303 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:34.743803 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:34.744595 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:34.745050 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:34.745600 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:34.894181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:34.901859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c3f7d41c-905b-406b-8334-580c24982679 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1313 microversion: 2.1 time: 0.170244 Sep 02 09:10:34.902587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 145/321] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:34 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:35.265718 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:35.267035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:35.273389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:35.273871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:35.274303 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:35.274996 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:35.275480 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:35.275985 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:35.276455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:35.305980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:35.381808 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-e1bc62fe-11a3-4722-9a73-27bbd1222f1c req-e127d0a3-f6a6-4e44-89dd-0341a8a45863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab40b56-752e-4b4a-a847-025419beaa1b", "name": "network-vif-plugged", "status": "completed", "tag": "39ed7331-124d-4623-8faf-66d95a6c6bdf"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:35.393086 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e1bc62fe-11a3-4722-9a73-27bbd1222f1c req-e127d0a3-f6a6-4e44-89dd-0341a8a45863 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:35.393923 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e1bc62fe-11a3-4722-9a73-27bbd1222f1c req-e127d0a3-f6a6-4e44-89dd-0341a8a45863 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:35.394466 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e1bc62fe-11a3-4722-9a73-27bbd1222f1c req-e127d0a3-f6a6-4e44-89dd-0341a8a45863 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:35.406176 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-e1bc62fe-11a3-4722-9a73-27bbd1222f1c req-e127d0a3-f6a6-4e44-89dd-0341a8a45863 service nova] Creating event network-vif-plugged:39ed7331-124d-4623-8faf-66d95a6c6bdf for instance 0ab40b56-752e-4b4a-a847-025419beaa1b on hv-cinder-85535 Sep 02 09:10:35.408049 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:35.411324 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-e1bc62fe-11a3-4722-9a73-27bbd1222f1c req-e127d0a3-f6a6-4e44-89dd-0341a8a45863 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033495 Sep 02 09:10:35.411919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 146/322] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:35.417386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2151b69a-fe0d-4698-8162-bc1dee8c51b7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.155353 Sep 02 09:10:35.418083 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 177/323] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:35 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:35.920500 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:35.925795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:35.926500 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:35.932855 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:35.933356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:35.933788 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:35.934474 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:35.934929 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:35.935379 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:36.060354 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:36.067926 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2ecc2b5-b9a4-4e2a-90b8-c612326cddc8 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1313 microversion: 2.1 time: 0.148474 Sep 02 09:10:36.068481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 147/324] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:35 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:36.437518 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:36.438163 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:36.444634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:36.445260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:36.445719 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:36.446564 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:36.446993 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:36.447497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:36.577516 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:36.585857 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c2c46d9-aae5-4020-8ca3-bd155d4ff1ab tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.152122 Sep 02 09:10:36.586432 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 178/325] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:36 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:37.088759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:37.089293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:37.095678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:37.096161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:37.096596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:37.097289 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:37.097777 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:37.098199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:37.231963 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:37.240070 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-09c131dd-4df7-49c3-a357-85aae63bc624 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1313 microversion: 2.1 time: 0.155358 Sep 02 09:10:37.240629 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 148/326] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:37 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:37.607045 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:37.608550 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:37.616786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:37.617369 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:37.617874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:37.618641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:37.619209 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:37.619717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:37.762812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:37.773724 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bd55092a-a578-4af3-a4cc-bfa7b0e1e13d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.170693 Sep 02 09:10:37.774298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 179/327] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:37 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:38.261694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:38.262674 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:38.270994 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:38.271596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:38.272072 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:38.275635 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:38.276224 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:38.276815 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:38.420633 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:38.428475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cc00ecb9-0bdf-41bb-9087-a7d5d67ea7b1 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1496 microversion: 2.1 time: 0.170606 Sep 02 09:10:38.429624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 149/328] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:38 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1496 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:38.795610 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:38.796309 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:38.803954 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:38.804668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:38.805493 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:38.806293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:38.806747 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:38.807283 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:38.968272 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:38.976301 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7771df53-741c-43f9-bbbb-0cd54eec6111 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.184846 Sep 02 09:10:38.991212 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 180/329] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:38 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:39.110704 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:39.111260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:39.118543 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:39.119028 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:39.119486 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:39.120297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:39.120749 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:39.121168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:39.149842 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:10:39.238761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f27426cf-cd48-486a-a7bb-d971b82324eb tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 204 len: 0 microversion: 2.1 time: 0.134969 Sep 02 09:10:39.240987 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 150/330] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:10:39 2022] DELETE /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:10:39.249167 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:39.249770 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:39.255849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:39.256575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:39.257074 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:39.257779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:39.258234 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:39.259003 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:39.426669 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:39.444371 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7b30d435-6a15-4036-9e64-b75b77b73b6f tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1502 microversion: 2.1 time: 0.198829 Sep 02 09:10:39.445092 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 181/331] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:39 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:39.998912 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:40.000512 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:40.003513 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:40.010299 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:40.010806 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:40.011415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:40.012118 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:40.012573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:40.012992 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:40.171687 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:40.180523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-10ad76c8-44a9-49fd-8612-84aaf84e0c89 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.186719 Sep 02 09:10:40.181219 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 151/332] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:39 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:40.465629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:40.466760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:40.473683 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:40.474160 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:40.474758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:40.475818 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:40.476420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:40.476989 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:40.492698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:40.634396 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:40.645155 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1e2879eb-6352-40a3-be2c-a59f5df1947e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1502 microversion: 2.1 time: 0.182945 Sep 02 09:10:40.645864 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 182/333] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:40 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:41.201955 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:41.202561 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:41.208814 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:41.209295 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:41.209733 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:41.210415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:41.210865 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:41.211312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:41.341315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:41.349505 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-72b726c9-bbdc-4b41-82aa-3c0c07251044 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.151656 Sep 02 09:10:41.350060 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 152/334] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:41 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:41.665864 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:41.666475 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:41.673316 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:41.673865 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:41.674362 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:41.675050 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:41.675529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:41.675957 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:41.807208 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:41.815657 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9e1f2b32-f2f5-45f1-82ad-0660e900187e tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1502 microversion: 2.1 time: 0.153630 Sep 02 09:10:41.816160 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 183/335] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:41 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:42.204755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-93fde70b-6c21-4f17-aa72-6155afed5472 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:42.205922 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-93fde70b-6c21-4f17-aa72-6155afed5472 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:42.215939 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fde70b-6c21-4f17-aa72-6155afed5472 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:42.216461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fde70b-6c21-4f17-aa72-6155afed5472 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:42.217484 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fde70b-6c21-4f17-aa72-6155afed5472 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:42.218389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fde70b-6c21-4f17-aa72-6155afed5472 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:42.219025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fde70b-6c21-4f17-aa72-6155afed5472 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:42.220231 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fde70b-6c21-4f17-aa72-6155afed5472 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:42.249449 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-93fde70b-6c21-4f17-aa72-6155afed5472 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/ips" status: 200 len: 145 microversion: 2.1 time: 0.049364 Sep 02 09:10:42.250118 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 153/336] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:10:42 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:42.371421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:42.372039 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:42.382059 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:42.382557 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:42.393600 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:42.394998 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:42.395520 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:42.395957 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:42.563431 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:42.571577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7b506b7e-d84a-4dc0-9d2d-5fa74b865e48 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.203740 Sep 02 09:10:42.572221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 184/337] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:42 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:42.836936 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:42.837591 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:42.843688 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:42.844169 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:42.844601 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:42.845284 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:42.845738 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:42.846156 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:42.991718 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:43.001693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eb445e7b-b8a2-4651-9444-384c2f32737a tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1502 microversion: 2.1 time: 0.168587 Sep 02 09:10:43.003444 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 154/338] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:42 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:43.066556 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-f284fc64-95b1-476f-8ecd-10e1f6c92bfb req-b888f750-fbda-4d73-a46b-2507066a5873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab40b56-752e-4b4a-a847-025419beaa1b", "name": "network-vif-deleted", "tag": "39ed7331-124d-4623-8faf-66d95a6c6bdf"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:43.077723 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f284fc64-95b1-476f-8ecd-10e1f6c92bfb req-b888f750-fbda-4d73-a46b-2507066a5873 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:43.078245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f284fc64-95b1-476f-8ecd-10e1f6c92bfb req-b888f750-fbda-4d73-a46b-2507066a5873 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:43.078968 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f284fc64-95b1-476f-8ecd-10e1f6c92bfb req-b888f750-fbda-4d73-a46b-2507066a5873 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:43.091385 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-f284fc64-95b1-476f-8ecd-10e1f6c92bfb req-b888f750-fbda-4d73-a46b-2507066a5873 service nova] Creating event network-vif-deleted:39ed7331-124d-4623-8faf-66d95a6c6bdf for instance 0ab40b56-752e-4b4a-a847-025419beaa1b on hv-cinder-85535 Sep 02 09:10:43.097350 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-f284fc64-95b1-476f-8ecd-10e1f6c92bfb req-b888f750-fbda-4d73-a46b-2507066a5873 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035098 Sep 02 09:10:43.098393 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 185/339] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:43.594940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:43.595587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:43.613728 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:43.614239 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:43.614681 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:43.615540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:43.616374 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:43.617112 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:43.807706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:43.823980 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-54db7d03-9bc2-4fad-94f5-2e697e93a6ee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.234540 Sep 02 09:10:43.825117 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 155/340] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:43 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:44.030036 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:44.030750 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:44.038136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:44.042159 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:44.054126 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:44.055210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:44.056091 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:44.057022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:44.149978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:44.150805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:44.151361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:44.151884 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lazy-loading 'fault' on Instance uuid 0ab40b56-752e-4b4a-a847-025419beaa1b {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:10:44.228549 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:44.241982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b1b4a852-05c6-4099-a9a8-10e412cf2ba7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1303 microversion: 2.1 time: 0.219824 Sep 02 09:10:44.242573 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 186/341] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:44 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1303 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:44.853405 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:44.854477 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:44.871160 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:44.872820 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:44.876763 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:44.877544 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:44.878090 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:44.879594 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:45.146426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:45.154157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6b15ca84-aab9-471b-bb07-d5a816080407 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.306724 Sep 02 09:10:45.168365 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 156/342] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:44 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:45.264648 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:45.265488 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:45.274893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:45.275606 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:45.276227 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:45.277137 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:45.277769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:45.278351 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:45.373936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:45.374420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:45.377230 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:45.377704 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lazy-loading 'fault' on Instance uuid 0ab40b56-752e-4b4a-a847-025419beaa1b {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:10:45.455472 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:45.464022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fa81921c-04d9-4cf9-b719-48271c5ce6f7 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1303 microversion: 2.1 time: 0.204472 Sep 02 09:10:45.464841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 187/343] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:45 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1303 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:46.176574 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:46.177859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:46.185730 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:46.186416 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:46.187021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:46.188592 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:46.189058 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:46.189638 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:46.413139 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:46.426070 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d126a014-e1da-45f5-837b-7ba3b080ef44 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.253674 Sep 02 09:10:46.440479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 157/344] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:46 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:46.487564 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:46.489059 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:46.512653 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:46.513897 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:46.514455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:46.515397 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:46.515933 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:46.516466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:46.589108 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:46.592614 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:46.593207 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:46.593874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lazy-loading 'fault' on Instance uuid 0ab40b56-752e-4b4a-a847-025419beaa1b {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:10:46.714884 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66133313929d4c0f98ab21b1ea336456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1883a19a6d24b36a063a5e673495a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:46.730259 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a277168a-ad03-4baf-b93e-55b026f4323c tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 200 len: 1303 microversion: 2.1 time: 0.247626 Sep 02 09:10:46.732779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 188/345] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:46 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 1303 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:47.419623 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b087af1d-d2ba-45e1-a9ca-6c73502a85ed tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15d96998-0f19-4011-a32b-bd5d7bc97693"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:47.432626 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b087af1d-d2ba-45e1-a9ca-6c73502a85ed tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:47.451604 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b087af1d-d2ba-45e1-a9ca-6c73502a85ed tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:47.451761 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:47.452303 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:47.452656 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b087af1d-d2ba-45e1-a9ca-6c73502a85ed tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:47.453245 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b087af1d-d2ba-45e1-a9ca-6c73502a85ed tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:47.454231 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b087af1d-d2ba-45e1-a9ca-6c73502a85ed tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:47.454838 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b087af1d-d2ba-45e1-a9ca-6c73502a85ed tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:47.456079 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b087af1d-d2ba-45e1-a9ca-6c73502a85ed tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:47.463981 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:47.464548 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:47.464994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:47.465729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:47.466190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:47.466618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:47.690017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:47.701398 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7ec8245f-98fa-42d1-8f0a-1b90cb53faa9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.254574 Sep 02 09:10:47.701987 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 189/346] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:47 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:47.752899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:47.753849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] [instance: 0ab40b56-752e-4b4a-a847-025419beaa1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:47.776939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:47.778203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:47.778631 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:47.779376 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:47.781363 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:47.782336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:47.819653 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] HTTP exception thrown: Instance 0ab40b56-752e-4b4a-a847-025419beaa1b could not be found. Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Request method failure captured: Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b HTTP/1.1 Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEchhtHr6fEt8x9bZnTWO0RhKfHC3BHK1W0M85xJHTf58KQuq-FtMvfJmG7KwOqhn68UxiT6JxgX7DDROVT0bM2pQ03KT5_CnjxBtB_Cluu9PzUIVLbpi2YpAXqOSvl23Wkz8UyvKGOldcx6B4odz0ZQZEvinZA47YVo12ZNDHzGiFPU Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: d1883a19a6d24b36a063a5e673495a51 Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesActionsTest-1566121694 Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:10:47.822102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1883a19a6d24b36a063a5e673495a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1883a19a6d24b36a063a5e673495a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1883a19a6d24b36a063a5e673495a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1883a19a6d24b36a063a5e673495a51", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesActionsTest-1566121694 Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: d1883a19a6d24b36a063a5e673495a51 Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesActionsTest-1566121694 Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesActionsTest-1566121694-project Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 66133313929d4c0f98ab21b1ea336456 Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesActionsTest-1566121694-project Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 0ab40b56-752e-4b4a-a847-025419beaa1b could not be found. Sep 02 09:10:47.823685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '0ab40b56-752e-4b4a-a847-025419beaa1b'} Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab40b56-752e-4b4a-a847-025419beaa1b could not be found. Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:10:47.824871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab40b56-752e-4b4a-a847-025419beaa1b could not be found. Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab40b56-752e-4b4a-a847-025419beaa1b could not be found. Sep 02 09:10:47.826314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:10:47.828719 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] Returning 404 to user: Instance 0ab40b56-752e-4b4a-a847-025419beaa1b could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:10:47.829756 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dd89046b-3083-48e7-b266-7a93c160bee0 tempest-VolumesActionsTest-1566121694 tempest-VolumesActionsTest-1566121694-project] 10.222.0.36 "GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b" status: 404 len: 111 microversion: 2.1 time: 0.081345 Sep 02 09:10:47.842979 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 190/347] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:47 2022] GET /compute/v2.1/servers/0ab40b56-752e-4b4a-a847-025419beaa1b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 09:10:47.898454 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:47.913173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b087af1d-d2ba-45e1-a9ca-6c73502a85ed tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497306 Sep 02 09:10:47.921194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 158/348] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:10:47 2022] POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:48.722643 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:48.723889 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:48.753038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:48.753659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:48.754114 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:48.754867 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:48.755361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:48.755786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:49.019720 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:49.034811 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b2e07fac-5e5d-45f2-9ab8-63fd1097ca4b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.316457 Sep 02 09:10:49.035641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 191/349] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:48 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:50.058080 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:50.060676 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:50.068677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:50.069169 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:50.069610 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:50.070320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:50.070783 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:50.071245 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:50.453068 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:50.461331 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4927d415-d37a-4f1d-8492-01de6c0c870a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.408616 Sep 02 09:10:50.461905 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 159/350] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:50 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:51.482676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:51.484147 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:51.501270 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:51.502284 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:51.502946 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:51.504881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:51.505352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:51.505787 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:51.790080 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:51.805213 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-498d666e-8255-47b4-86a3-274f17cd2b67 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.326931 Sep 02 09:10:51.820792 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 192/351] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:51 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:52.830847 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:52.834022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:52.852906 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:52.853640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:52.858755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:52.860349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:52.861109 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:52.861768 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:53.069652 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:53.080249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e221bc58-4438-4c5f-863b-7a8a77b03fb9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.254851 Sep 02 09:10:53.081358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 160/352] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:52 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:53.803827 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e62c9642-ccb6-4673-bbe8-b586f80f22a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Action: 'create', calling method: .version_select at 0x7f54bc907f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-343451252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfBPL+YWuOqyeHwAavwXAQCm3bs4QIyJqe9trzDuK8gBjcnayWUN+QjEJp931lpTkP9/PJUpk64CclswUScqtFBZ8j9vG+YlGn/3iTZiZvBcMjXwPmjKLC9miSiBb1xmA=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:10:53.809179 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:10:53.821830 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-e62c9642-ccb6-4673-bbe8-b586f80f22a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Getting quotas for project d81e4ab123d54ebdbf4165e250967df6. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:10:53.825901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-e62c9642-ccb6-4673-bbe8-b586f80f22a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Getting quotas for user 0fd2f1b7788a4095a28f8fb6917c5705 and project d81e4ab123d54ebdbf4165e250967df6. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:10:53.848034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e62c9642-ccb6-4673-bbe8-b586f80f22a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.251262 Sep 02 09:10:53.848635 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 193/353] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:10:53 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:10:54.101051 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:54.102681 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:54.128095 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:54.129049 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:54.129507 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:54.130183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:54.130795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:54.131380 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:54.342932 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:54.362627 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c6418b42-3a00-48b1-904a-f75fb538099a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.265404 Sep 02 09:10:54.364490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 161/354] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:54 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:55.385154 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:55.385711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:55.393472 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:55.394003 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:55.394476 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:55.395343 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:55.395844 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:55.396328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:55.536463 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:55.544505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-10755dd1-96cd-4d91-b78a-e2023f37ad71 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.164753 Sep 02 09:10:55.545078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 194/355] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:55 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:56.565499 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:56.566763 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:56.573401 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:56.573889 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:56.574593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:56.575341 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:56.575815 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:56.576229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:56.729077 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:56.741096 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0d821606-ebe9-4b63-ac2a-b90bb523ff64 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.179593 Sep 02 09:10:56.741782 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 162/356] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:56 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:56.836483 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bae98149-34c0-4eb4-bebe-a85fe0e17e1a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:56.837033 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bae98149-34c0-4eb4-bebe-a85fe0e17e1a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:56.843754 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bae98149-34c0-4eb4-bebe-a85fe0e17e1a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:56.844733 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bae98149-34c0-4eb4-bebe-a85fe0e17e1a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:56.845167 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bae98149-34c0-4eb4-bebe-a85fe0e17e1a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:56.845860 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bae98149-34c0-4eb4-bebe-a85fe0e17e1a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:56.846311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bae98149-34c0-4eb4-bebe-a85fe0e17e1a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:56.846729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bae98149-34c0-4eb4-bebe-a85fe0e17e1a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:56.878894 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bae98149-34c0-4eb4-bebe-a85fe0e17e1a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/ips" status: 200 len: 150 microversion: 2.20 time: 0.046302 Sep 02 09:10:56.879714 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 195/357] 10.222.0.36 () {60 vars in 1289 bytes} [Fri Sep 2 09:10:56 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:10:57.763115 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:57.763761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:57.770941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:57.771506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:57.771971 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:57.772694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:57.773178 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:57.773631 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:57.904989 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:57.912903 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f12b5ea-647e-46a1-ac6f-7118b157c4eb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.153687 Sep 02 09:10:57.913493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 163/358] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:57 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:10:58.933671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:10:58.935193 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:10:58.942934 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:58.943592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:58.944207 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:58.945005 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:10:58.945536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:10:58.946170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:10:59.123784 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:10:59.131608 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3328eec8-225c-48a7-bd85-7645dcd18ce2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.201843 Sep 02 09:10:59.132171 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 196/359] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:10:58 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:00.152945 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:00.154280 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:00.161356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:00.161767 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:00.162579 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:00.163548 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:00.164194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:00.164614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:00.315424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:00.323510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4986b50a-ccbb-4ef4-938c-acdfdbf7a4bc tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.175344 Sep 02 09:11:00.324726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 164/360] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:00 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:01.133782 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:01.134360 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:01.140762 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.141453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.141882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.142562 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.143012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.143459 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.168247 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lazy-loading 'flavor' on Instance uuid 5d6b1337-6402-4108-aef8-2ad90760a201 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:11:01.347970 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:01.348578 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:01.355057 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.355564 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.355994 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.356699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.357610 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.359366 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.587801 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:01.598386 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6589da73-f893-4ad9-9179-c3c876075fec tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1502 microversion: 2.1 time: 0.255060 Sep 02 09:11:01.600012 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 165/361] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:01 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1502 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:01.618471 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e6654da9-7cd9-4ed2-b679-29be5eab1629 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:01.619343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e6654da9-7cd9-4ed2-b679-29be5eab1629 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:01.630944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6654da9-7cd9-4ed2-b679-29be5eab1629 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.631740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6654da9-7cd9-4ed2-b679-29be5eab1629 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.632274 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6654da9-7cd9-4ed2-b679-29be5eab1629 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.633324 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6654da9-7cd9-4ed2-b679-29be5eab1629 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.633945 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6654da9-7cd9-4ed2-b679-29be5eab1629 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.634616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6654da9-7cd9-4ed2-b679-29be5eab1629 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.671381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e6654da9-7cd9-4ed2-b679-29be5eab1629 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/ips" status: 200 len: 150 microversion: 2.1 time: 0.058617 Sep 02 09:11:01.679891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 166/362] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:11:01 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/ips => generated 150 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:01.687226 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d0b716d-741b-4630-9e7c-e8f250c26168"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:01.691050 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:01.698396 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.699767 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.700371 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.701294 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.702766 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.703589 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.732100 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] HTTP exception thrown: Cannot 'attach_volume' instance 5d56b84b-6132-4d68-8ead-b4a14070a060 while it is in vm_state rescued Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Request method failure captured: Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060/os-volume_attachments HTTP/1.1 Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 74 Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgc-uyj7G6dkesaoNotQXdG__Azb6l7pI9LJKFcZj1PxIrGFALWEzddAGu90ss9M-9iP9TCYmteOUjCJf4oYRyOi8Luhyj05cqciZdmQ8jCPqUJXj0HSPqyyQS2_cu0OrG6pklymGb8Aj6MPaar9pB3jV51Db9oha0q2YpmIr2Kv1M Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:11:01.735872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6fde620889f34b04bb7c9fcd5ad0a368", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: bf58157cbc8e49c5bd913c68ff859bfb Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {"volumeAttachment": {"volumeId": "6d0b716d-741b-4630-9e7c-e8f250c26168"}} Sep 02 09:11:01.737473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Cannot 'attach_volume' instance 5d56b84b-6132-4d68-8ead-b4a14070a060 while it is in vm_state rescued Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'server_id': '5d56b84b-6132-4d68-8ead-b4a14070a060', 'body': {'volumeAttachment': {'volumeId': '6d0b716d-741b-4630-9e7c-e8f250c26168'}}} Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d56b84b-6132-4d68-8ead-b4a14070a060 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:11:01.738481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5d56b84b-6132-4d68-8ead-b4a14070a060 while it is in vm_state rescued Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:11:01.739886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:11:01.741207 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:11:01.741207 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:11:01.741207 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5d56b84b-6132-4d68-8ead-b4a14070a060 while it is in vm_state rescued Sep 02 09:11:01.741207 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:11:01.743253 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Returning 409 to user: Cannot 'attach_volume' instance 5d56b84b-6132-4d68-8ead-b4a14070a060 while it is in vm_state rescued {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:11:01.744267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-018e5f2f-dcd5-487b-bd20-a47b6ea5123f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063066 Sep 02 09:11:01.749074 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 167/363] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:11:01 2022] POST /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 09:11:01.756227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-85830cf1-4e9f-48cc-ad8e-12169babb4fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:01.756986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-85830cf1-4e9f-48cc-ad8e-12169babb4fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:01.763947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85830cf1-4e9f-48cc-ad8e-12169babb4fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.764632 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85830cf1-4e9f-48cc-ad8e-12169babb4fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.765230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85830cf1-4e9f-48cc-ad8e-12169babb4fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.766386 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85830cf1-4e9f-48cc-ad8e-12169babb4fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.766981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85830cf1-4e9f-48cc-ad8e-12169babb4fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.767570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85830cf1-4e9f-48cc-ad8e-12169babb4fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.895713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-85830cf1-4e9f-48cc-ad8e-12169babb4fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060/action" status: 202 len: 0 microversion: 2.1 time: 0.143207 Sep 02 09:11:01.896750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 168/364] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:11:01 2022] POST /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:11:01.906698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:01.907513 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:01.915691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.916495 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.916688 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:01.917532 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:01.918254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:01.918700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:02.156342 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:02.191522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d8c4dc82-f376-4eda-96fb-da786be25c03 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1510 microversion: 2.1 time: 0.284145 Sep 02 09:11:02.196472 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 169/365] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:01 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:02.830648 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:02.831505 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:02.839663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:02.840153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:02.840587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:02.841288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:02.841781 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:02.842390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:03.131191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lazy-loading 'services' on Instance uuid e7331a63-41b1-44e3-8eec-2498b8817212 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:11:03.291037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1fe116c4-b519-4d1a-8026-04c78ecd00f3 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212/os-volume_attachments/09c9210b-eaab-4178-8b82-d50ec9b047f5" status: 202 len: 0 microversion: 2.1 time: 0.463682 Sep 02 09:11:03.292222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 170/366] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:11:02 2022] DELETE /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212/os-volume_attachments/09c9210b-eaab-4178-8b82-d50ec9b047f5 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 09:11:03.321778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:03.367283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:03.390474 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:03.393659 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:03.394141 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:03.399760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:03.400367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:03.415475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:03.652416 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:03.681520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-50cacdd7-2979-4f86-bfd9-e8be6bc79745 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1510 microversion: 2.1 time: 0.386470 Sep 02 09:11:03.683059 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 171/367] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:03 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:03.689272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8989c454-9afa-4192-9c5b-a15cbe37f845 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:03.696534 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8989c454-9afa-4192-9c5b-a15cbe37f845 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:03.697489 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8989c454-9afa-4192-9c5b-a15cbe37f845 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:03.698093 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8989c454-9afa-4192-9c5b-a15cbe37f845 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:03.794199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8989c454-9afa-4192-9c5b-a15cbe37f845 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Going to try to stop instance {{(pid=120572) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 02 09:11:03.832944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:03.853706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8989c454-9afa-4192-9c5b-a15cbe37f845 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/action" status: 202 len: 0 microversion: 2.1 time: 0.169093 Sep 02 09:11:03.854785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 172/368] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:11:03 2022] POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:11:03.860815 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-89b7473b-b4f8-428e-99d1-4df40c8ef393 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c15f2e4-9ad3-45cc-87ce-dac04449f47b"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:03.864509 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-89b7473b-b4f8-428e-99d1-4df40c8ef393 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:03.871860 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b7473b-b4f8-428e-99d1-4df40c8ef393 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:03.872401 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b7473b-b4f8-428e-99d1-4df40c8ef393 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:03.872847 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b7473b-b4f8-428e-99d1-4df40c8ef393 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:03.873562 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b7473b-b4f8-428e-99d1-4df40c8ef393 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:03.874012 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b7473b-b4f8-428e-99d1-4df40c8ef393 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:03.874606 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b7473b-b4f8-428e-99d1-4df40c8ef393 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:03.894718 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=94,nova_cell1:UPDATE=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:04.872766 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-89b7473b-b4f8-428e-99d1-4df40c8ef393 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.016327 Sep 02 09:11:04.873476 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 173/369] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:11:03 2022] POST /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments => generated 194 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:04.879617 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:04.880594 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:04.887788 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:04.888358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:04.888894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:04.889765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:04.890315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:04.891700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:05.088183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:05.098850 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b97c4f8e-de39-482c-8f7a-6e1719cb76ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.223873 Sep 02 09:11:05.100291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 174/370] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:04 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:05.105128 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:05.106034 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:05.121428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:05.121991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:05.122462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:05.123233 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:05.123848 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:05.124461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:05.312708 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:05.317622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a5c6159d-5384-4395-b3e6-2e38cab1490d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1510 microversion: 2.1 time: 0.216119 Sep 02 09:11:05.327446 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 175/371] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:05 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:06.122947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:06.124330 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:06.132598 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:06.133553 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:06.134232 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:06.135026 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:06.135576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:06.136088 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:06.317975 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:06.327164 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0eeac01e-2fe6-4946-997d-c712222f2872 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.208138 Sep 02 09:11:06.339975 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 176/372] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:06 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:06.350017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:06.350876 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:06.357820 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:06.358566 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:06.359223 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:06.361287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:06.361762 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:06.362229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:06.509496 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:06.519115 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8493e91e-21e0-4785-8683-3983f8c6e5f6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1510 microversion: 2.1 time: 0.178055 Sep 02 09:11:06.519689 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 177/373] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:06 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:07.354127 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:07.354776 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:07.363874 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:07.364372 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:07.364812 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:07.365523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:07.365962 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:07.367561 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:07.603678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:07.613216 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4b15ab31-cfac-4308-b25c-b09e47ae5e12 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.265740 Sep 02 09:11:07.616774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 178/374] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:07 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:07.622063 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:07.622710 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:07.631590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:07.632094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:07.632520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:07.633258 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:07.633723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:07.634144 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:07.837898 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:07.848533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ecd53c68-c9ed-47a6-b5ac-bf7110a62bea tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1510 microversion: 2.1 time: 0.230613 Sep 02 09:11:07.849477 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 179/375] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:07 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:07.854619 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:07.855162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:07.862622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:07.863322 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:07.863760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:07.864459 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:07.865025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:07.865401 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:07.905632 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:11:08.005830 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e449da82-8d97-46b5-a257-9372adb1a3d5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 204 len: 0 microversion: 2.1 time: 0.154584 Sep 02 09:11:08.006507 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 180/376] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:11:07 2022] DELETE /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:11:08.015522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:08.016833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:08.022974 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:08.023666 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:08.024572 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:08.025522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:08.025907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:08.026613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:08.193231 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:08.201245 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f5a1d15-d6e2-4559-826b-fae5e8625173 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1513 microversion: 2.1 time: 0.189915 Sep 02 09:11:08.201809 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 181/377] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:08 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:08.642580 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:08.643287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:08.649544 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:08.650034 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:08.650448 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:08.651159 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:08.651615 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:08.652033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:08.788442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:08.800017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-79172c7a-5146-48ed-a0f7-1343ef14e519 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.164025 Sep 02 09:11:08.800592 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 182/378] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:08 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:08.871177 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:08.871782 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:08.877767 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:08.878227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:08.878659 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:08.879429 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:08.879835 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:08.880255 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:09.017053 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:09.024837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7dc7ea39-86cb-4692-a64f-46ebe83ee9f2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1516 microversion: 2.1 time: 0.157595 Sep 02 09:11:09.025402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 183/379] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:08 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:09.223567 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:09.224177 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:09.230184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:09.230669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:09.231135 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:09.231829 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:09.232340 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:09.232705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:09.404269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:09.412103 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-77ffa60e-9663-48b6-b79b-7a63b7275664 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1513 microversion: 2.1 time: 0.192329 Sep 02 09:11:09.412673 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 184/380] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:09 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:09.821235 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:09.822022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:09.829812 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:09.830379 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:09.831098 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:09.831868 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:09.832329 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:09.832758 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:09.995377 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:10.005906 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-155a86b1-b8e3-4063-8a47-dd4a838eb294 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.188693 Sep 02 09:11:10.012131 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 185/381] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:09 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:10.433153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:10.433919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:10.436412 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:10.445115 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:10.445612 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:10.446080 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:10.446787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:10.447270 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:10.447700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:10.590273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:10.611693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fe2b06de-88d1-474b-b47f-90be56151a42 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1513 microversion: 2.1 time: 0.182525 Sep 02 09:11:10.619225 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 186/382] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:10 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:10.636552 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6686e2a8-1e82-4baf-a142-5476f809b18a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'create', calling method: .version_select at 0x7f54bc58f5e0>, body: {"keypair": {"name": "tempest-keypair-1619577540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEicxzYYZYGlRCeS/8cP9Z8IIsr7Kcp+vsNRRipHuc8Fde3A9/p+5B1RuiPUYdUbLcrjwnGMyI1E9i/4W+kQrgjr4bCaA2ee45vj0wq/jFbdfv6Da1K7oHIY7AY00jGCQ=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:10.659362 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-6686e2a8-1e82-4baf-a142-5476f809b18a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Getting quotas for project 6fde620889f34b04bb7c9fcd5ad0a368. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:11:10.664643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-6686e2a8-1e82-4baf-a142-5476f809b18a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Getting quotas for user bf58157cbc8e49c5bd913c68ff859bfb and project 6fde620889f34b04bb7c9fcd5ad0a368. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:11:10.697698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6686e2a8-1e82-4baf-a142-5476f809b18a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076990 Sep 02 09:11:10.698318 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 187/383] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:11:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:11.029394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:11.030801 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:11.041853 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:11.043804 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:11.046112 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:11.046857 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:11.049478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:11.049930 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:11.060876 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:11.140732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:11.243850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:11.327723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:11.339426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2fee8a3c-4d7b-46bf-8171-dc423bc8e68c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.314121 Sep 02 09:11:11.349431 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 188/384] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:11 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:11.356278 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-2433e541-30ad-478d-a6f5-dfd02cec511a req-4f422ac7-abaf-4b62-82dd-38ef80bc8e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7331a63-41b1-44e3-8eec-2498b8817212", "name": "network-vif-deleted", "tag": "6e50eb45-f687-438f-abeb-4bd6303fc38b"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:11.399400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2433e541-30ad-478d-a6f5-dfd02cec511a req-4f422ac7-abaf-4b62-82dd-38ef80bc8e3e service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:11.401328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2433e541-30ad-478d-a6f5-dfd02cec511a req-4f422ac7-abaf-4b62-82dd-38ef80bc8e3e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:11.402203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2433e541-30ad-478d-a6f5-dfd02cec511a req-4f422ac7-abaf-4b62-82dd-38ef80bc8e3e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:11.422500 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-2433e541-30ad-478d-a6f5-dfd02cec511a req-4f422ac7-abaf-4b62-82dd-38ef80bc8e3e service nova] Creating event network-vif-deleted:6e50eb45-f687-438f-abeb-4bd6303fc38b for instance e7331a63-41b1-44e3-8eec-2498b8817212 on hv-cinder-85535 Sep 02 09:11:11.431736 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-2433e541-30ad-478d-a6f5-dfd02cec511a req-4f422ac7-abaf-4b62-82dd-38ef80bc8e3e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078255 Sep 02 09:11:11.432660 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 189/385] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:11.636707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:11.637849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:11.665410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:11.665913 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:11.666515 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:11.667165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:11.667584 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:11.668007 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:11.747674 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:11.748213 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:11.748646 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:11.749293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lazy-loading 'fault' on Instance uuid e7331a63-41b1-44e3-8eec-2498b8817212 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:11:11.802279 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:11.810398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08463c75-bcb8-4bdc-a065-b7467317063b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 200 len: 1309 microversion: 2.1 time: 0.180459 Sep 02 09:11:11.815036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 190/386] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:11 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 1309 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:12.362921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:12.363626 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:12.374352 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:12.374844 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:12.376052 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:12.376989 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:12.377678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:12.378306 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:12.542017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:12.554454 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eb9cd0ce-3658-45ed-b938-f0288e2b8125 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.196971 Sep 02 09:11:12.555022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 191/387] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:12 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:12.570404 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1262458032", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e97c2add-51c7-4c3b-b8b8-fa1c6867698c"}], "security_groups": [{"name": "tempest-securitygroup--242224563"}], "key_name": "tempest-keypair-1619577540", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:20.673568 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-52a1b507-45c0-4595-b20b-1381ce6cf674 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/action" status: 202 len: 0 microversion: 2.20 time: 19.543632 Sep 02 09:11:20.678431 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 197/388] 10.222.0.36 () {62 vars in 1319 bytes} [Fri Sep 2 09:11:01 2022] POST /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/action => generated 0 bytes in 19549 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:11:20.680289 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:20.696441 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:20.697546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: e7331a63-41b1-44e3-8eec-2498b8817212] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:20.708252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:20.709055 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:20.709549 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:20.710433 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:20.711629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:20.712376 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:20.726969 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] HTTP exception thrown: Instance e7331a63-41b1-44e3-8eec-2498b8817212 could not be found. Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Request method failure captured: Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 HTTP/1.1 Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEchK306ohkuMCgGW7cBCdk0Vr4viisiCKIF9vpimHyjUf9wtGRs-86m8cwMg9KjGdzVj1DTf9QJbfTQnfclm__y-RN-AsTjjEFksBCpcP8533_Rau1hYwRtCibKUCyX2-ZLkLRMsYhYMgO4HUfs9_MjCMmRXYVJp-3pQSL62GU19FjY Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 85a7c3487e204650adc69b55ef3feb66 Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1873986334 Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:11:20.729538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85a7c3487e204650adc69b55ef3feb66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a7c3487e204650adc69b55ef3feb66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a7c3487e204650adc69b55ef3feb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85a7c3487e204650adc69b55ef3feb66", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesSnapshotTestJSON-1873986334 Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 85a7c3487e204650adc69b55ef3feb66 Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1873986334 Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesSnapshotTestJSON-1873986334-project Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: e1daf1c8526245a9854f9b8672fa4222 Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesSnapshotTestJSON-1873986334-project Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance e7331a63-41b1-44e3-8eec-2498b8817212 could not be found. Sep 02 09:11:20.731404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': 'e7331a63-41b1-44e3-8eec-2498b8817212'} Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7331a63-41b1-44e3-8eec-2498b8817212 could not be found. Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:11:20.732359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7331a63-41b1-44e3-8eec-2498b8817212 could not be found. Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7331a63-41b1-44e3-8eec-2498b8817212 could not be found. Sep 02 09:11:20.733874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:11:20.736657 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Returning 404 to user: Instance e7331a63-41b1-44e3-8eec-2498b8817212 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:11:20.737760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-905425f9-1e1b-423e-a193-3fbb66df517c tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212" status: 404 len: 111 microversion: 2.1 time: 0.057945 Sep 02 09:11:20.738837 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 198/389] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:20 2022] GET /compute/v2.1/servers/e7331a63-41b1-44e3-8eec-2498b8817212 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:11:20.743967 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:20.744923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:20.749140 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] validate_networks() for [('e97c2add-51c7-4c3b-b8b8-fa1c6867698c', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:11:20.752467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:20.753201 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:20.753926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:20.755550 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:20.756358 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:20.757020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:20.987368 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:21.000088 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d173d202-f801-48e8-8b4c-946550773063 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.259798 Sep 02 09:11:21.001619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 199/390] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:20 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:21.007468 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2b061531-dfc1-455e-8990-2fd11cdc231e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: .version_select at 0x7f54bc5cd5e0>, body: {"keypair": {"name": "tempest-keypair-441634133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwXsCuuVmmhvFCJDa1mGdADGRsFDhW9tHKRyJ303Z3vVwEmzg0IVqilX+ncUXwRaqH8x7J/60C8gWEx+HFqSzwbk147uhdhTPZhkyTFnwGj3pqBGVGDo2CECNOpvMryvA=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:21.027973 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-2b061531-dfc1-455e-8990-2fd11cdc231e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:11:21.038807 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-2b061531-dfc1-455e-8990-2fd11cdc231e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for user e8b5ce2249a84c01ab57c03b656b2949 and project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:11:21.061865 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2b061531-dfc1-455e-8990-2fd11cdc231e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058791 Sep 02 09:11:21.062643 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 200/391] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:11:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:21.068300 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-607315142", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:21.128300 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] validate_networks() for None {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:11:21.541010 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:11:21.541432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:11:21.541905 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:11:21.542314 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:11:21.542725 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:11:21.552033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:21.552513 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:21.552946 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:21.553671 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:21.554123 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:21.554545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:21.571867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Getting quotas for project 6fde620889f34b04bb7c9fcd5ad0a368. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:11:21.575975 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Getting quotas for user bf58157cbc8e49c5bd913c68ff859bfb and project 6fde620889f34b04bb7c9fcd5ad0a368. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:11:21.586612 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:11:21.588958 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:11:21.590380 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:11:21.590798 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:11:21.591288 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:11:21.591874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:11:21.592285 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:11:21.602182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:21.602668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:21.603489 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:21.604341 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:21.604803 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:21.605396 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:21.624954 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Getting quotas for project 8851adb9a8a0495aa7660431a99d5eee. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:11:21.630353 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Getting quotas for user f1b7b3a759604adcb7be3fe78f998f4f and project 8851adb9a8a0495aa7660431a99d5eee. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:11:21.638835 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c89e284a-782f-4633-98a5-b9ec0b031388 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.072598 Sep 02 09:11:21.640042 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 192/392] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:11:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 9074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 09:11:21.643484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:11:21.645281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:21.645862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:11:21.646017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:21.652187 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:21.652979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:21.653592 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:21.654590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:21.655230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:21.655810 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:21.714091 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf4b6ec6-909d-4869-bcdd-a51b44240e53 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649954 Sep 02 09:11:21.714734 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 201/393] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:11:21.719466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2d4b8ec3-9d5b-4f21-b344-73550be32418 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:21.720266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2d4b8ec3-9d5b-4f21-b344-73550be32418 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:21.831981 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2d4b8ec3-9d5b-4f21-b344-73550be32418 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:21.841222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2d4b8ec3-9d5b-4f21-b344-73550be32418 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1246 microversion: 2.1 time: 0.125249 Sep 02 09:11:21.842031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 202/394] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:21 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:21.854269 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-72c59c20-c6a3-4b98-a4d8-1b79bc385422 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:21.854269 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-72c59c20-c6a3-4b98-a4d8-1b79bc385422 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:21.864416 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:21.873629 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:21.875977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:21.877314 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-536807ed-3ec0-45f0-b6ef-ed944680683d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.236256 Sep 02 09:11:21.877940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 193/395] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:21 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:21.933411 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-72c59c20-c6a3-4b98-a4d8-1b79bc385422 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:21.942644 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-72c59c20-c6a3-4b98-a4d8-1b79bc385422 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1214 microversion: 2.1 time: 0.098694 Sep 02 09:11:21.943702 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 203/396] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:21 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:22.028558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:22.029176 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:22.039238 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:22.041827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:22.041827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:22.042616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:22.043387 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:22.045818 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:22.211053 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:22.220374 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-43c61479-6e46-4331-9a83-42612f5e6712 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.195716 Sep 02 09:11:22.221168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 194/397] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:22 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:22.684347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-216554931", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "426b5f66-dceb-4940-aa95-179f2d5137c7"}], "security_groups": [{"name": "tempest-securitygroup--991826624"}], "key_name": "tempest-keypair-441634133", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:22.783083 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] validate_networks() for [('426b5f66-dceb-4940-aa95-179f2d5137c7', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:11:22.862521 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:22.863272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:22.869811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:22.870421 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:22.870716 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:22.871447 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:22.871901 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:22.872337 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:22.936643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:22.945689 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-04e9ccc5-b21e-484e-8bbd-06ee03de2d9e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1250 microversion: 2.1 time: 0.087789 Sep 02 09:11:22.946282 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 195/398] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:22 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:22.951036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:22.951663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:22.957532 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:22.959195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:22.959195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:22.959195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:22.959646 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:22.960049 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:23.159677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:23.167641 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:23.169170 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:23.170427 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d4fa683b-0869-4082-a8e1-9cd5cb382884 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.223230 Sep 02 09:11:23.171052 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 196/399] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:22 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:23.190362 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:23.190977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:23.196846 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:23.197328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:23.197760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:23.198441 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:23.198889 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:23.199334 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:23.249510 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:11:23.249937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:11:23.250512 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:11:23.250928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:11:23.251402 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:11:23.260038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:23.260529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:23.260994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:23.261722 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:23.262182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:23.262628 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:23.264643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:23.272293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3fb0c0a9-c8a6-47ef-ac73-ba06075eb8b4 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1218 microversion: 2.1 time: 0.085434 Sep 02 09:11:23.272853 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 197/400] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:23 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:23.277296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:23.277892 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:23.283535 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:11:23.287339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for user e8b5ce2249a84c01ab57c03b656b2949 and project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:11:23.289941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:23.290437 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:23.290917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:23.291759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:23.292247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:23.292674 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:23.300003 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:11:23.302227 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:11:23.350744 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7b93d9f4-c61e-4932-96b1-139c40d00899 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.670277 Sep 02 09:11:23.351356 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 204/401] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:11:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:11:23.364506 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cb6c4498-295d-4a17-88be-d1aea54eb143 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:23.365220 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cb6c4498-295d-4a17-88be-d1aea54eb143 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:23.431089 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cb6c4498-295d-4a17-88be-d1aea54eb143 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:23.441088 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cb6c4498-295d-4a17-88be-d1aea54eb143 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1240 microversion: 2.1 time: 0.080641 Sep 02 09:11:23.452979 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 205/402] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:23 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:23.479300 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:23.487520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f2e2534f-4334-4581-a9c2-ec4d73230659 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.213618 Sep 02 09:11:23.488090 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 198/403] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:23 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:23.966129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:23.966666 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:23.972993 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:23.973467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:23.973896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:23.974572 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:23.975027 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:23.975468 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:24.034268 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:24.041686 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9df90bdc-2469-41d8-98bd-5e5c6042b4ed tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1250 microversion: 2.1 time: 0.079447 Sep 02 09:11:24.042237 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 206/404] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:23 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:24.193967 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:24.194579 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:24.201148 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:24.201632 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:24.202068 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:24.202750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:24.203232 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:24.203658 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:24.293404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:24.294013 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:24.300629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:24.301113 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:24.301576 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:24.302266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:24.302725 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:24.303169 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:24.328355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:24.337573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:24.339133 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:24.340319 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-faa88655-5917-43e7-86db-d439307bdb8a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.150721 Sep 02 09:11:24.342415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 199/405] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:24 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:24.364371 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:24.373865 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-96bc4c90-3fc2-4dbb-b104-f12d5d0bd282 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1218 microversion: 2.1 time: 0.084267 Sep 02 09:11:24.375111 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 207/406] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:24 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:24.463784 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:24.464429 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:24.471422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:24.471912 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:24.472534 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:24.473457 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:24.474108 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:24.474678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:24.509555 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:24.510429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:24.520847 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:24.521444 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:24.522706 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:24.523471 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:24.523932 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:24.524358 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:24.548587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:24.560011 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-00b8ec30-5f3a-440f-bc6a-4b6b4cb65fbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1244 microversion: 2.1 time: 0.100500 Sep 02 09:11:24.561913 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 200/407] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:24 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:24.694800 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:24.704713 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b5526c5f-878b-4651-977b-dccbf562fc19 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.199411 Sep 02 09:11:24.713072 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 208/408] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:24 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:25.062138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:25.062823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:25.069766 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.070089 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.070588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.071343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.071828 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.072250 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.157926 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:25.167989 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7cb12c0e-7205-4158-818d-b4a3e5d7f5ae tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1298 microversion: 2.1 time: 0.109685 Sep 02 09:11:25.168996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 201/409] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:25 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:25.364175 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:25.364781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:25.372078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.372862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.373564 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.374550 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.375805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.376488 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.401986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:25.404915 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:25.413080 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.413570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.414005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.414707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.415186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.415616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.763283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:25.772252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6967efe5-602d-4ce5-b093-8cdbbdfc4652 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1266 microversion: 2.1 time: 0.377810 Sep 02 09:11:25.786083 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 202/410] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:25 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1266 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:25.791198 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:25.792107 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:25.799258 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.800165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.800848 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.801782 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.802456 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.803134 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.843802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:25.857671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:25.859454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:25.861168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c7499928-fbbe-4082-9129-4d5973079bb9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.501421 Sep 02 09:11:25.872133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 209/411] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:25 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:25.879884 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:25.880055 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:25.880232 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:25.887353 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fba7c4ba-83fa-4341-9565-9d67e97ee235 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1292 microversion: 2.1 time: 0.099808 Sep 02 09:11:25.891117 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.891978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.892598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.893308 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:25.893769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:25.894199 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:25.895426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 203/412] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:25 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1292 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:26.045028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:26.055975 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4b9eed5b-8566-410b-8161-517604493262 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.184125 Sep 02 09:11:26.063157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 210/413] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:25 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:26.191004 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:26.191932 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:26.206285 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:26.208825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:26.209506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:26.210777 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:26.213263 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:26.214827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:26.396390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:26.415376 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f2fd4a3b-2bdf-4244-9dcf-bcfcd0d3acef tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1298 microversion: 2.1 time: 0.224054 Sep 02 09:11:26.415981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 204/414] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:26 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1298 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:26.795948 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:26.798499 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:26.807298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:26.808135 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:26.808882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:26.809808 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:26.810812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:26.811364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:26.890217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:26.891890 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:26.904749 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:26.906769 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:26.907707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:26.910024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:26.910877 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:26.912937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:26.945318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:26.961260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5e8817ef-83cc-411e-9e60-e924eef5df3c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1266 microversion: 2.1 time: 0.170378 Sep 02 09:11:26.966684 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 211/415] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:26 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:26.980775 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:26.981826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:26.989088 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:26.989850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:26.990482 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:26.991575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:26.992345 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:26.992785 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:27.116553 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:27.126050 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-71a72258-95a0-4ee8-95b9-30475cc2eb24 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1298 microversion: 2.1 time: 0.157174 Sep 02 09:11:27.127039 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 212/416] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:26 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:27.149303 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:27.150344 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:27.158002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:27.158748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:27.159497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:27.161129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:27.161880 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:27.162593 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:27.282357 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:27.287501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:27.296886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:27.299516 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:27.300790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1775e149-5037-478c-a918-472a472ec887 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.415297 Sep 02 09:11:27.301431 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 205/417] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:26 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:27.354020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:27.364370 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e525626d-c3f4-468a-8250-30ed471273da tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.220773 Sep 02 09:11:27.364989 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 213/418] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:27 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:27.439843 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:27.441529 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:27.452053 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:27.452555 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:27.452998 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:27.453829 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:27.454299 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:27.454733 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:27.520181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:27.528148 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ca501d23-4502-4e82-880d-c5f8894cba18 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1316 microversion: 2.1 time: 0.094137 Sep 02 09:11:27.528735 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 206/419] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:27 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:27.987849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:27.988599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:27.995533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:27.996240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:27.996903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:27.997819 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:27.998293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:27.998911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:28.069116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:28.078148 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1c918a3d-d4e3-417f-804d-30b9ac610b14 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1274 microversion: 2.1 time: 0.094357 Sep 02 09:11:28.079905 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 214/420] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:27 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:28.153540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:28.155191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:28.168292 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:28.169533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:28.170165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:28.171287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:28.172268 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:28.173254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:28.267977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:28.276036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14f79115-27f4-4c9b-a3cb-14de493c4acd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1298 microversion: 2.1 time: 0.129985 Sep 02 09:11:28.276641 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 207/421] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:28 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1298 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:28.327913 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:28.328587 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:28.335345 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:28.335817 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:28.336283 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:28.337079 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:28.337470 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:28.337908 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:28.386006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:28.386796 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:28.396123 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:28.396789 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:28.397319 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:28.398171 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:28.398722 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:28.399349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:28.623170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:28.632782 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:28.634538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:28.635806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c0b5ede7-b0c0-48fa-b70c-bf462ad3e57d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.312156 Sep 02 09:11:28.651357 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 215/422] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:28 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:28.651677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:28.656534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:28.659031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:28.664998 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-072127cd-79f6-41a5-861b-e1f59b5e9060 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.282606 Sep 02 09:11:28.665163 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:28.665555 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:28.666119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:28.666501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 208/423] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:28 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:28.680580 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:28.681097 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:28.681559 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:28.757765 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:28.766331 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9cfc1e3a-9b3a-414c-bc29-6e063ba6add1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1316 microversion: 2.1 time: 0.127902 Sep 02 09:11:28.767106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 216/424] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:28 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1316 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:29.103341 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:29.104296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:29.110944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:29.111511 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:29.112000 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:29.112764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:29.113264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:29.113760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:29.190859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:29.200065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-344af444-0887-41d4-9cb6-c0b85454bc22 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1274 microversion: 2.1 time: 0.100542 Sep 02 09:11:29.200692 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 209/425] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:29 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:29.297693 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:29.298297 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:29.304956 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:29.305444 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:29.305873 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:29.306751 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:29.307244 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:29.307827 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:29.400911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:29.408649 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-33481219-5906-4fcf-9a17-35f7ace835c0 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1298 microversion: 2.1 time: 0.114790 Sep 02 09:11:29.409255 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 217/426] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:29 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:29.659165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:29.659709 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:29.665733 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:29.666433 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:29.666866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:29.667596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:29.668208 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:29.668786 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:29.692233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:29.693276 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:29.701676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:29.702155 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:29.703098 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:29.703863 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:29.704324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:29.704742 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:29.974266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:29.983158 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:29.992089 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:29.993611 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:29.996565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3af70e9f-6e5b-41c1-92e3-4ee1a372b878 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.312382 Sep 02 09:11:29.997352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 218/427] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:29 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:29.999228 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f8c787e7-6767-4277-a183-32bc3878b35a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.339632 Sep 02 09:11:30.000429 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 210/428] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:29 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:30.004200 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:30.005331 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:30.020809 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:30.021417 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:30.022138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:30.024227 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:30.025038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:30.025853 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:30.116719 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:30.124941 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fa2cb24d-7dcd-4c6f-87d8-13c1e400dd50 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1316 microversion: 2.1 time: 0.126810 Sep 02 09:11:30.129653 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 219/429] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:29 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1316 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:30.223858 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:30.224717 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:30.245856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:30.246583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:30.247427 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:30.248850 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:30.249337 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:30.250278 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:30.322068 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:30.331865 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4afe9d5d-5487-43c4-9266-b1e48346f4fe tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1274 microversion: 2.1 time: 0.113931 Sep 02 09:11:30.332455 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 211/430] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:30 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1274 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:30.429982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:30.432027 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:30.443138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:30.443640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:30.444079 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:30.444788 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:30.445273 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:30.446197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:30.465246 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:30.510674 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:30.518561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4c5485ed-e668-4c9a-a4d7-9ff630e6856e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1298 microversion: 2.1 time: 0.092703 Sep 02 09:11:30.519363 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 220/431] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:30 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:31.028410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:31.029902 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:31.030735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:31.033081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:31.052092 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.054898 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.056426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.057225 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.060474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.061089 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.065593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.066348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.067051 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.067763 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.070119 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.070754 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.565932 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:31.566664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:31.572491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:31.575379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:31.577019 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-493cf58b-ce78-41ce-b7e9-84b9f9d61d4f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.554490 Sep 02 09:11:31.589707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:31.591672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 221/432] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:31 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:31.601948 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:31.602988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:31.611284 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.611404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.612006 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.612828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.613389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.613820 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.728976 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:31.740235 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-be817ff8-7ab3-4f8a-b25a-2fbd2af413b9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.721189 Sep 02 09:11:31.755477 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 212/433] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:31 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:31.762109 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:31.763032 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:31.769541 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:31.770355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.771824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.772431 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.774366 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.776003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.780839 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6753e39e-b239-45a4-bd0e-42640cadfc1a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1304 microversion: 2.1 time: 0.187024 Sep 02 09:11:31.781939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 222/434] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:31 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:31.787048 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:31.794479 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:31.805527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.806333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.814558 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.815062 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.817636 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:31.818290 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:31.818883 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:31.925373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:31.936844 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a9182e32-368a-4bd0-ab0d-51acc7813a66 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1272 microversion: 2.1 time: 0.179939 Sep 02 09:11:31.939621 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 213/435] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:31 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:31.996470 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-266760729", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "networks": [{"uuid": "fddd3ae7-592f-4937-aa54-9e2bbc2e9e43"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:32.063297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] validate_networks() for [('fddd3ae7-592f-4937-aa54-9e2bbc2e9e43', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:11:32.236220 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:32.246870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b1eff5f4-714e-4aa2-a3b6-d6bd19a2a32d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1365 microversion: 2.1 time: 0.463811 Sep 02 09:11:32.260527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 223/436] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:31 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1365 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:32.382510 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-e8cbb599-8c10-40ce-8f7a-3ddd1763a11c req-34494633-42c2-4b98-b40a-6dc8e1b63b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66889932-9d4e-49d9-aaed-bf65390e4a7c", "tag": "8201c509-a0f2-4be2-8be7-e498b7469477"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:32.389338 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:32.397236 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e8cbb599-8c10-40ce-8f7a-3ddd1763a11c req-34494633-42c2-4b98-b40a-6dc8e1b63b8f service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:32.398054 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e8cbb599-8c10-40ce-8f7a-3ddd1763a11c req-34494633-42c2-4b98-b40a-6dc8e1b63b8f service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:32.399214 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e8cbb599-8c10-40ce-8f7a-3ddd1763a11c req-34494633-42c2-4b98-b40a-6dc8e1b63b8f service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:32.414426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-e8cbb599-8c10-40ce-8f7a-3ddd1763a11c req-34494633-42c2-4b98-b40a-6dc8e1b63b8f service nova] Creating event network-changed:8201c509-a0f2-4be2-8be7-e498b7469477 for instance 66889932-9d4e-49d9-aaed-bf65390e4a7c on hv-cinder-85535 Sep 02 09:11:32.421383 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-e8cbb599-8c10-40ce-8f7a-3ddd1763a11c req-34494633-42c2-4b98-b40a-6dc8e1b63b8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042343 Sep 02 09:11:32.422903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 224/437] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:11:32.603513 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:32.604212 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:32.611259 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:32.611758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:32.612197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:32.612905 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:32.613557 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:32.613989 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:33.035237 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:33.044549 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:33.046196 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:33.047654 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d2220e66-ba95-4f76-9e7c-0a778cef8265 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.449038 Sep 02 09:11:33.048279 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 225/438] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:32 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:33.054851 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:33.055747 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:33.063510 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:33.064087 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:33.064581 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:33.065872 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:33.066056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:33.066577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:33.221742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:11:33.222245 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:11:33.222637 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:11:33.223050 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:11:33.223501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:11:33.233230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:33.233597 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:33.234342 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:33.235608 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:33.236099 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:33.236529 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:33.262640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Getting quotas for project 85a7c3487e204650adc69b55ef3feb66. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:11:33.267028 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Getting quotas for user e1daf1c8526245a9854f9b8672fa4222 and project 85a7c3487e204650adc69b55ef3feb66. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:11:33.270706 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:33.282728 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:11:33.285092 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:11:33.337896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ff4980c6-31c0-4d9b-a507-9a550771c8ec tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345345 Sep 02 09:11:33.344883 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 214/439] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 09:11:33.355500 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:33.356287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:33.358598 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:33.366830 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:33.367533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:33.368058 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:33.368918 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:33.369467 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:33.369983 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:33.433984 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:33.441375 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=22 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:33.451056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-87b702f9-351f-4355-b199-fa37520b67cd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.401388 Sep 02 09:11:33.452472 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 226/440] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:33 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:33.460063 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:33.461390 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:33.467797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:33.468356 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:33.468968 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:33.469652 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:33.470120 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:33.470608 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:33.639661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:33.652682 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bb324630-b347-4e99-801e-85dcf87e93e1 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1272 microversion: 2.1 time: 0.197836 Sep 02 09:11:33.654185 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 227/441] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:33 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:33.666710 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1157390736", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-343451252", "security_groups": [{"name": "tempest-secgroup-smoke-507740159"}], "networks": [{"uuid": "7676d2e2-6db9-4d14-b42d-78e164443204"}], "block_device_mapping_v2": [{"uuid": "39ba8b89-2db9-46ce-b082-54a8c4b8c0f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:34.057732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:34.083458 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e617986d-c9f1-41af-93e7-24881f4e6b46 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1371 microversion: 2.1 time: 0.722702 Sep 02 09:11:34.083458 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 215/442] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:33 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1371 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:34.093551 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:34.095202 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:34.104370 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:34.105179 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:34.105779 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:34.107663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:34.109068 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:34.109761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:34.199392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] validate_networks() for [('7676d2e2-6db9-4d14-b42d-78e164443204', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:11:34.547847 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:34.558493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a1a65dfd-2c27-44bf-9752-e630586afb19 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1365 microversion: 2.1 time: 0.486657 Sep 02 09:11:34.560325 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 216/443] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:34 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1365 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:34.565943 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:34.566841 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:34.574123 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:34.574870 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:34.575733 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:34.576688 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:34.577478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:34.578016 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:34.717132 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:34.729954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9a4bcbe6-f9f6-427a-a80e-ed3eab2a0205 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1270 microversion: 2.1 time: 0.168123 Sep 02 09:11:34.731506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 217/444] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:34 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:34.736586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:34.737605 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:34.743756 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:34.744816 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:34.745240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:34.745934 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:34.746597 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:34.747024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:35.262702 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:35.289867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:35.295424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:35.300403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-98c2760e-ba8e-4b3e-b849-8cc2ce00e0f6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.566408 Sep 02 09:11:35.301083 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 218/445] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:34 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:35.330683 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:35.331344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:35.350291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:35.350787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:35.351261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:35.351979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:35.352434 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:35.352864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:35.497067 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:11:35.497542 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:11:35.498005 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:11:35.498455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:11:35.499763 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:11:35.519214 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:35.520061 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:35.521338 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:35.522266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:35.523177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:35.523791 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:35.569965 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Getting quotas for project d81e4ab123d54ebdbf4165e250967df6. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:11:35.576034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Getting quotas for user 0fd2f1b7788a4095a28f8fb6917c5705 and project d81e4ab123d54ebdbf4165e250967df6. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:11:35.668436 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:11:35.670779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39ba8b89-2db9-46ce-b082-54a8c4b8c0f5',volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:11:35.770269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:35.780586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-24cbcf0d-b0d6-4172-b111-fa03b3256640 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.465140 Sep 02 09:11:35.782288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 219/446] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:35 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:35.787844 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:35.788782 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:35.796468 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:35.798855 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:35.799677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:35.800545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:35.801368 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:35.801981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:35.902634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eefcc5a5-64fa-48be-a08b-14799849c868 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.244646 Sep 02 09:11:35.905810 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 228/447] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:11:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:11:35.920564 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:35.926958 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:35.935889 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:35.936707 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:35.937362 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:35.938939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:35.939612 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:35.940349 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.295247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:36.303349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ff320546-06a1-4f14-8227-005c959ce492 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.519702 Sep 02 09:11:36.304138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 220/448] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:35 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:36.308735 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-625799fc-1bfe-4c73-a707-8e35f88d7e6c req-c79059ce-36f3-40fe-a1e2-bbf067c93eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a43d50-d1ca-449a-82ef-3df6b6fa88b8", "tag": "91ef318d-54a2-4c8e-ab4c-a5d4963d60aa"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:36.328871 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-625799fc-1bfe-4c73-a707-8e35f88d7e6c req-c79059ce-36f3-40fe-a1e2-bbf067c93eca service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.332595 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-625799fc-1bfe-4c73-a707-8e35f88d7e6c req-c79059ce-36f3-40fe-a1e2-bbf067c93eca service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.333326 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-625799fc-1bfe-4c73-a707-8e35f88d7e6c req-c79059ce-36f3-40fe-a1e2-bbf067c93eca service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.349810 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-625799fc-1bfe-4c73-a707-8e35f88d7e6c req-c79059ce-36f3-40fe-a1e2-bbf067c93eca service nova] Creating event network-changed:91ef318d-54a2-4c8e-ab4c-a5d4963d60aa for instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 on hv-cinder-85535 Sep 02 09:11:36.364666 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-625799fc-1bfe-4c73-a707-8e35f88d7e6c req-c79059ce-36f3-40fe-a1e2-bbf067c93eca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059059 Sep 02 09:11:36.366035 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 221/449] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:36.373181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:36.374206 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:36.383589 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.384632 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.385273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.386358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.387024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.387694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.406418 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:36.419710 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e141fc6a-0105-411d-aeb3-cf5c60eb6ab7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1371 microversion: 2.1 time: 0.511537 Sep 02 09:11:36.423811 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 229/450] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:35 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1371 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:36.439042 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:36.439681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:36.452588 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.454704 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.455530 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.456579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.457190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.458415 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.774494 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:36.789434 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-025ef8c2-4521-4555-8e7e-09905a53f824 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1365 microversion: 2.1 time: 0.419209 Sep 02 09:11:36.790424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 222/451] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:36 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:36.806297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:36.810381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:36.819943 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.820866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.821469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.823153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.823907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.824484 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.837617 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:36.845300 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b8d457e-607d-4082-8735-3bb1894dcb83 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.419158 Sep 02 09:11:36.845880 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 230/452] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:36 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:36.861072 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:36.861896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:36.868936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.870450 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.871189 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.872640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.873257 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.874349 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.928043 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:36.930585 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:36.941116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-444a09cf-01a3-4fdb-879d-d9507717acf2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1130 microversion: 2.1 time: 0.149158 Sep 02 09:11:36.941949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 223/453] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:36 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1130 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:36.947886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:36.948701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:36.955148 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.955822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.956438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:36.957286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:36.958107 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:36.958669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.148267 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:37.156876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:37.158561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:37.159981 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b02e621b-1a3e-4451-a3b5-3888ea03cb50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.313185 Sep 02 09:11:37.160857 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 231/454] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:36 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:37.189934 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:37.198491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4ce4d088-6613-4138-b0aa-ed64364470ad tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.255120 Sep 02 09:11:37.212821 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 224/455] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:36 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:37.332610 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:37.333368 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:37.340244 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.340808 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.341498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.342268 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.342786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.343487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.447286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:37.448769 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:37.461655 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.462332 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.462931 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.463857 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.464462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.466464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.579894 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:37.588916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-135e7a54-e949-4c77-b778-cdf8ab7cd8e7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.267030 Sep 02 09:11:37.591531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 232/456] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:37 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:37.596508 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-5c208697-46cf-46a5-a422-195fcafa9aa8 req-787c9297-7694-455b-b5e2-c10ec26a300c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52664c0-7a4e-4477-8873-3323ad3d7b1b", "tag": "8b38c879-463d-4f33-a9c3-a823dc481ba6"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:37.614325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-5c208697-46cf-46a5-a422-195fcafa9aa8 req-787c9297-7694-455b-b5e2-c10ec26a300c service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.615964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-5c208697-46cf-46a5-a422-195fcafa9aa8 req-787c9297-7694-455b-b5e2-c10ec26a300c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.616694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-5c208697-46cf-46a5-a422-195fcafa9aa8 req-787c9297-7694-455b-b5e2-c10ec26a300c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.639143 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-5c208697-46cf-46a5-a422-195fcafa9aa8 req-787c9297-7694-455b-b5e2-c10ec26a300c service nova] Creating event network-changed:8b38c879-463d-4f33-a9c3-a823dc481ba6 for instance a52664c0-7a4e-4477-8873-3323ad3d7b1b on hv-cinder-85535 Sep 02 09:11:37.644403 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-5c208697-46cf-46a5-a422-195fcafa9aa8 req-787c9297-7694-455b-b5e2-c10ec26a300c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051511 Sep 02 09:11:37.645279 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 233/457] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:37.650286 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-14d15979-93a8-4ec0-8ff6-cf1738ecb2ee req-50769a40-e131-4526-8401-23e50daf6139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66889932-9d4e-49d9-aaed-bf65390e4a7c", "name": "network-vif-plugged", "status": "completed", "tag": "8201c509-a0f2-4be2-8be7-e498b7469477"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:37.660753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-14d15979-93a8-4ec0-8ff6-cf1738ecb2ee req-50769a40-e131-4526-8401-23e50daf6139 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.661309 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-14d15979-93a8-4ec0-8ff6-cf1738ecb2ee req-50769a40-e131-4526-8401-23e50daf6139 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.661787 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-14d15979-93a8-4ec0-8ff6-cf1738ecb2ee req-50769a40-e131-4526-8401-23e50daf6139 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.668489 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:37.677274 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-98d1f51c-9dd0-4444-974d-c4e07c353cf7 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1371 microversion: 2.1 time: 0.236169 Sep 02 09:11:37.686274 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-14d15979-93a8-4ec0-8ff6-cf1738ecb2ee req-50769a40-e131-4526-8401-23e50daf6139 service nova] Creating event network-vif-plugged:8201c509-a0f2-4be2-8be7-e498b7469477 for instance 66889932-9d4e-49d9-aaed-bf65390e4a7c on hv-cinder-85535 Sep 02 09:11:37.691750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 225/458] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:37 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:37.692541 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-14d15979-93a8-4ec0-8ff6-cf1738ecb2ee req-50769a40-e131-4526-8401-23e50daf6139 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045741 Sep 02 09:11:37.693124 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 234/459] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:37.811331 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:37.812070 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:37.820139 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.820631 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.821163 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.822040 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.822499 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.822926 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.868019 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:37.868719 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:37.874824 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.875888 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.878964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:37.878964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:37.878964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:37.878964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.018009 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:38.026791 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d9ed5a62-968d-4a30-9c43-6edf2a0797dc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1365 microversion: 2.1 time: 0.220847 Sep 02 09:11:38.028595 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 226/460] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:37 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:38.034844 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:38.035850 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:38.050528 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:38.073987 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.077284 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c820f439-ef1a-427f-baf5-002558d95f62 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.213374 Sep 02 09:11:38.078006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.078798 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.079697 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.080313 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.081662 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.083010 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 235/461] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:37 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:38.183846 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:38.184738 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:38.204963 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.205923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.206767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.207932 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:38.208227 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.208850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.209436 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.226820 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f169ca63-364b-4c24-95cb-6248ee2f745f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1186 microversion: 2.1 time: 0.195713 Sep 02 09:11:38.228765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 227/462] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:38 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1186 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:38.239764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:38.242668 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:38.260066 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.260761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.263448 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.265241 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.266172 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.266835 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.858019 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:38.862993 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:38.867579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:38.869233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:38.870584 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-29e899b5-662f-422b-b0bd-febb489d22b0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.690727 Sep 02 09:11:38.871584 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 236/463] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:38 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:38.876334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:38.877105 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:38.883559 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.884176 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.884599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.885341 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.885851 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.886342 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.887143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9ac3297b-15f9-4b7c-9c2f-473b44ea93a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.657156 Sep 02 09:11:38.887811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 228/464] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:38 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:38.909636 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-0f8bad1c-d7f1-4722-a24b-e54b945676a9 req-d9c2271b-05eb-4e69-87ad-8f2a332dc417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0654ac5d-1e96-4e6c-9f82-93887a119738", "tag": "1abad2f1-426c-4c22-b29e-39bd8fb03553"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:38.920028 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0f8bad1c-d7f1-4722-a24b-e54b945676a9 req-d9c2271b-05eb-4e69-87ad-8f2a332dc417 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.920677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0f8bad1c-d7f1-4722-a24b-e54b945676a9 req-d9c2271b-05eb-4e69-87ad-8f2a332dc417 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.921497 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0f8bad1c-d7f1-4722-a24b-e54b945676a9 req-d9c2271b-05eb-4e69-87ad-8f2a332dc417 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.933478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-0f8bad1c-d7f1-4722-a24b-e54b945676a9 req-d9c2271b-05eb-4e69-87ad-8f2a332dc417 service nova] Creating event network-changed:1abad2f1-426c-4c22-b29e-39bd8fb03553 for instance 0654ac5d-1e96-4e6c-9f82-93887a119738 on hv-cinder-85535 Sep 02 09:11:38.944762 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-0f8bad1c-d7f1-4722-a24b-e54b945676a9 req-d9c2271b-05eb-4e69-87ad-8f2a332dc417 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055543 Sep 02 09:11:38.945372 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 229/465] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:38.954570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:38.955364 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:38.964424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.964918 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.965357 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:38.966069 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:38.966526 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:38.966955 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.382211 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:39.391474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8b29ec9f-d407-4295-87f0-aa94c6598130 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.518108 Sep 02 09:11:39.392542 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 237/466] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:38 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:39.411441 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:39.412258 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:39.418128 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.418616 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.419259 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.419958 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.420420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.420837 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.421532 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:39.430071 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1469ab78-eb9d-4ff2-a60f-8fc75d0f8db8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1371 microversion: 2.1 time: 0.483243 Sep 02 09:11:39.430740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 230/467] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:38 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1371 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:39.436106 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:39.437047 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:39.445251 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.445813 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.446405 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.447157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.447610 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.448265 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.649318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:39.652012 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:39.660037 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-63141a19-df65-4f36-9a18-fa38441da0be tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1365 microversion: 2.1 time: 0.265574 Sep 02 09:11:39.660737 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eaf4b585-b908-43c0-82e9-ccaee4218691 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.228478 Sep 02 09:11:39.661821 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 238/468] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:39 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:39.666932 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:39.667699 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:39.672203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 231/469] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:39 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:39.691521 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.692289 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.692943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.693894 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.694631 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.695252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.779429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:39.783764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:39.790413 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ba86640e-56d9-466e-8c5a-d52676339b6d tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1204 microversion: 2.1 time: 0.127027 Sep 02 09:11:39.791113 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 239/470] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:39 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1204 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:39.894223 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:39.897262 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:39.909812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:39.910428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:39.919662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.920152 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.920584 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.922896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.923478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.924153 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.924608 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.925032 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.926598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:39.927100 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:39.929070 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:39.929546 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.165338 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:40.168333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:40.174455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-200a40a9-ff9a-4601-9e05-bb67fde2e0ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1699 microversion: 2.1 time: 0.269170 Sep 02 09:11:40.175177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 240/471] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:39 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1699 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:40.177138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:40.178566 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:40.179741 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d7a8107-4f8f-4c4b-97b4-df2c6dd2cbb8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.290371 Sep 02 09:11:40.180504 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 232/472] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:39 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:40.195158 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6ce3f0fe-cde9-4f08-932d-36d94e5221cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:40.201655 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ce3f0fe-cde9-4f08-932d-36d94e5221cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.202174 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ce3f0fe-cde9-4f08-932d-36d94e5221cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.202609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ce3f0fe-cde9-4f08-932d-36d94e5221cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.265327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6ce3f0fe-cde9-4f08-932d-36d94e5221cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Going to try to start instance {{(pid=120573) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 02 09:11:40.306150 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6ce3f0fe-cde9-4f08-932d-36d94e5221cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/action" status: 202 len: 0 microversion: 2.1 time: 0.114573 Sep 02 09:11:40.306659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 241/473] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:11:40 2022] POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:11:40.314716 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:40.315370 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:40.321537 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.322066 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.322423 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.323152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.323608 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.324036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.416919 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:40.417665 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:40.425944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.426915 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.427389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.428702 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.429160 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.429580 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.510407 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:40.521040 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b72adb24-655b-40af-b7fa-fc7f8fce060c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1708 microversion: 2.1 time: 0.210121 Sep 02 09:11:40.522319 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 233/474] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:40 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1708 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:40.527733 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:40.528512 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:40.536362 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.536893 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.537314 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.538009 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.538460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.538879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.598009 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:40.606168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5b901ee8-56b3-4bc3-91c1-b4b9afd72e5d tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.195141 Sep 02 09:11:40.606927 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 242/475] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:40 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:40.680094 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:40.680973 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:40.688441 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.689096 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.689624 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.690403 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.690957 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.691485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.691597 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:40.699013 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-148ace3a-e13a-4723-9750-11d7bdd85d68 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1371 microversion: 2.1 time: 0.175475 Sep 02 09:11:40.699633 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 234/476] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:40 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:40.710807 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:40.711448 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:40.717250 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.717737 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.718344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.718887 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.719451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.719877 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.904536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:40.909727 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:40.912970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bdeeb9dc-fbd5-4024-8d45-1df76540463a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1365 microversion: 2.1 time: 0.236834 Sep 02 09:11:40.913617 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 243/477] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:40 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:40.926651 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d554edf7-ef28-4e72-ab89-720551de65dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.218060 Sep 02 09:11:40.933366 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:40.934343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 235/478] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:40 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:40.934485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:40.941936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.942434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.942871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:40.943676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:40.944144 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:40.944575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.081732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:41.089564 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0630983e-8013-4290-9e49-fea342d1881e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1271 microversion: 2.1 time: 0.159908 Sep 02 09:11:41.090138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 244/479] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:40 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:41.202878 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:41.203511 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:41.209923 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.210438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.210867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.211574 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.212024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.212444 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.344642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:41.349879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:41.351351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:41.352495 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0d499105-23fa-427f-b284-240142f977a4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.153572 Sep 02 09:11:41.353413 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 236/480] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:41 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:41.543216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:41.543829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:41.549696 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.550182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.550615 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.551325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.551779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.552197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.629768 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:41.630565 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:41.638535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.639036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.639653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.640405 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.641438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.641925 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.710012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:41.722351 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-09f1dd5b-e363-4f72-bccc-1e589a0c5b40 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1708 microversion: 2.1 time: 0.182746 Sep 02 09:11:41.723405 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 245/481] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:41 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1708 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:41.730386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-e30e365d-60ac-4017-8a04-22d864dad76a req-288027a1-990b-404b-8e5e-bde7a7e16d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a43d50-d1ca-449a-82ef-3df6b6fa88b8", "name": "network-vif-plugged", "status": "completed", "tag": "91ef318d-54a2-4c8e-ab4c-a5d4963d60aa"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:41.741098 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e30e365d-60ac-4017-8a04-22d864dad76a req-288027a1-990b-404b-8e5e-bde7a7e16d83 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.741726 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e30e365d-60ac-4017-8a04-22d864dad76a req-288027a1-990b-404b-8e5e-bde7a7e16d83 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.742149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e30e365d-60ac-4017-8a04-22d864dad76a req-288027a1-990b-404b-8e5e-bde7a7e16d83 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.755188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-e30e365d-60ac-4017-8a04-22d864dad76a req-288027a1-990b-404b-8e5e-bde7a7e16d83 service nova] Creating event network-vif-plugged:91ef318d-54a2-4c8e-ab4c-a5d4963d60aa for instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 on hv-cinder-85535 Sep 02 09:11:41.760725 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-e30e365d-60ac-4017-8a04-22d864dad76a req-288027a1-990b-404b-8e5e-bde7a7e16d83 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035895 Sep 02 09:11:41.761942 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 246/482] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:41.767193 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:41.767893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:41.773916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.774408 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.774843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.775566 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.776022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.776449 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.801508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:41.810751 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0dc76f38-09ed-4b6c-84df-ddbbd65a6dca tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.186299 Sep 02 09:11:41.811340 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 237/483] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:41 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:41.911147 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:41.918878 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2e04e906-8aca-41d1-b96b-43e0242dca7c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1371 microversion: 2.1 time: 0.155798 Sep 02 09:11:41.919487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 247/484] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:41 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:41.933800 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:41.935437 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:41.940851 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.941348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.941790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.942036 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:41.942496 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.942666 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:41.942956 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.943427 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.949598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.950078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.950836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:41.951616 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:41.952076 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:41.952540 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.194997 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:42.198547 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:42.203956 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ace00d45-c5a8-464c-9712-94e814dc489e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1556 microversion: 2.1 time: 0.273431 Sep 02 09:11:42.204519 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 238/485] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:41 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1556 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:42.207480 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4c99cece-03c7-42c1-993e-70f7b4927ddb tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.270051 Sep 02 09:11:42.219549 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 248/486] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:41 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:42.221186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:42.221794 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:42.224794 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a720660e-ae8f-4105-8515-74bea50813dd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:42.225283 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a720660e-ae8f-4105-8515-74bea50813dd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:42.230061 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.230436 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.230948 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.231491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a720660e-ae8f-4105-8515-74bea50813dd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.231748 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.232066 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a720660e-ae8f-4105-8515-74bea50813dd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.232201 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.232508 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a720660e-ae8f-4105-8515-74bea50813dd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.232648 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.233410 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a720660e-ae8f-4105-8515-74bea50813dd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.234051 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a720660e-ae8f-4105-8515-74bea50813dd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.235028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a720660e-ae8f-4105-8515-74bea50813dd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.344039 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a720660e-ae8f-4105-8515-74bea50813dd tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123162 Sep 02 09:11:42.345112 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 249/487] 10.222.0.36 () {58 vars in 1275 bytes} [Fri Sep 2 09:11:42 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:11:42.377544 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:42.378262 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:42.384525 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.385090 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.385601 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.386377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.386912 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.387578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.412527 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:42.421081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b2d3234-cc81-4eae-9717-cfab17d350d3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1271 microversion: 2.1 time: 0.215206 Sep 02 09:11:42.422159 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 239/488] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:42 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:42.538198 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:42.549544 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:42.551172 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:42.552670 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e8482467-e7c0-411a-a0b0-0dc94986eb33 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.180157 Sep 02 09:11:42.555111 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 250/489] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:42 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:11:42.744616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:42.745514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:42.760949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.762238 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.765549 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.768407 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.769227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.769871 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.834252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:42.834689 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:42.848938 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.856944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.857777 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:42.860726 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:42.862936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:42.867553 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.211208 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:43.215161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:43.225960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f00392af-b1b8-42ce-a06e-7e6357e1b08a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1708 microversion: 2.1 time: 0.485284 Sep 02 09:11:43.239186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 240/490] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:42 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1708 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:43.239400 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6bbb64eb-4478-4e93-a6e8-2b85d6137157 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.397877 Sep 02 09:11:43.239493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:43.239493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:43.239493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:43.239703 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:43.240253 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.241301 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:43.241712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 251/491] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:42 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:43.242146 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:43.242648 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.245754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:43.246502 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:43.246618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:43.247426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:43.255269 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:43.255757 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:43.256189 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.256891 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:43.257420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:43.257843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.277162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:43.709431 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:43.720934 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9364ea73-d5f4-4bc8-a4eb-1bc48bdc5ad4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1371 microversion: 2.1 time: 0.492700 Sep 02 09:11:43.721517 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 241/492] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:43 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:43.722800 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:43.729099 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:43.729916 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:43.734709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f3f33702-3345-4fdb-b52f-74f306bf9389 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.490933 Sep 02 09:11:43.735852 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 252/493] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:43 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:43.741108 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-aee0f897-7af5-4225-972a-a28698eeaed3 req-16ab8bf8-a61f-4d94-bc63-637f6b4cee69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d867d4df-9d60-4213-9895-3583d7914735", "tag": "f8ab8844-1efe-4e80-a575-5c63bfe8bdda"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:43.749039 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:43.749979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:43.750704 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.751861 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:43.752771 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-aee0f897-7af5-4225-972a-a28698eeaed3 req-16ab8bf8-a61f-4d94-bc63-637f6b4cee69 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:43.753215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-aee0f897-7af5-4225-972a-a28698eeaed3 req-16ab8bf8-a61f-4d94-bc63-637f6b4cee69 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:43.753476 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:43.753664 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-aee0f897-7af5-4225-972a-a28698eeaed3 req-16ab8bf8-a61f-4d94-bc63-637f6b4cee69 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.754286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.779277 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-aee0f897-7af5-4225-972a-a28698eeaed3 req-16ab8bf8-a61f-4d94-bc63-637f6b4cee69 service nova] Creating event network-changed:f8ab8844-1efe-4e80-a575-5c63bfe8bdda for instance d867d4df-9d60-4213-9895-3583d7914735 on hv-cinder-85535 Sep 02 09:11:43.784597 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-aee0f897-7af5-4225-972a-a28698eeaed3 req-16ab8bf8-a61f-4d94-bc63-637f6b4cee69 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047529 Sep 02 09:11:43.785595 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 253/494] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:43.790562 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:43.791279 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:43.799680 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:43.800171 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:43.800790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.801293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:43.801740 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:43.802158 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:43.970509 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:43.978171 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f45f7c63-48c2-4129-9650-f1d572de576a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.255500 Sep 02 09:11:43.987383 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 242/495] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:43 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:44.000594 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:44.008700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:44.010120 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:44.011292 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-093c067a-1569-4335-9f98-fc8ff0affd75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.224609 Sep 02 09:11:44.011840 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 254/496] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:43 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:44.249133 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:44.249780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:44.249932 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:44.251364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:44.257899 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:44.258224 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:44.258634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:44.259214 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:44.259352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:44.259931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:44.260277 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:44.260391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:44.261315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:44.261694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:44.262540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:44.263272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:44.468665 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:44.480357 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c63fbfb4-fa59-406f-9448-3ea8e15935dc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.235004 Sep 02 09:11:44.491040 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 243/497] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:44 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:44.501670 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:44.509830 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a35e6eb1-92d9-4c9d-a17a-868c8e6996ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1708 microversion: 2.1 time: 0.264614 Sep 02 09:11:44.510399 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 255/498] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:44 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1708 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:44.742054 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:44.742752 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:44.751329 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:44.752150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:44.752824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:44.753754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:44.754866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:44.756042 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:44.758001 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:44.758790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:44.765509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:44.766001 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:44.766439 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:44.767219 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:44.767747 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:44.768176 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:44.978823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:44.982563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:44.991926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a19a1e5b-4e7e-42c3-b418-d301fa225d45 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.237823 Sep 02 09:11:44.992074 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a0864588-d74b-416e-9ba9-b839fb5c5e84 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1371 microversion: 2.1 time: 0.254227 Sep 02 09:11:44.993692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 256/499] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:44 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:45.002732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 244/500] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:44 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:45.005296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:45.005919 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:45.012685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:45.013362 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:45.013982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:45.014679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:45.015197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:45.015632 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:45.019959 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:45.034249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:45.034857 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:45.046315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:45.047011 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:45.048294 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:45.049186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:45.050066 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:45.050592 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:45.300548 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:45.309227 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-36ef41ec-cc4b-47e3-a482-c4a97497f4b3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.314524 Sep 02 09:11:45.309992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 257/501] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:44 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:45.372443 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:45.383405 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:45.384992 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:45.386174 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aa42eebf-1486-4ed5-bff0-89778d8f9c41 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.356318 Sep 02 09:11:45.386751 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 245/502] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:45 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:11:45.503517 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:45.504335 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:45.514252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:45.514252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:45.514252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:45.514252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:45.514640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:45.514640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:45.532186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:45.533326 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:45.534580 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:45.542107 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:45.542780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:45.543638 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:45.544748 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:45.545337 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:45.545856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:45.592380 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:46.241325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:46.249736 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5fee53c2-7fcb-4ddc-8ece-5a508cb77fa7 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.750625 Sep 02 09:11:46.250803 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 258/503] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:45 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:46.256494 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-eaaf4d14-baea-4b32-9461-62e60677444a req-cd4731b2-5278-490f-9a59-b913cfdc17d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0654ac5d-1e96-4e6c-9f82-93887a119738", "name": "network-vif-plugged", "status": "completed", "tag": "1abad2f1-426c-4c22-b29e-39bd8fb03553"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:46.267778 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-eaaf4d14-baea-4b32-9461-62e60677444a req-cd4731b2-5278-490f-9a59-b913cfdc17d3 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.268323 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-eaaf4d14-baea-4b32-9461-62e60677444a req-cd4731b2-5278-490f-9a59-b913cfdc17d3 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.268734 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-eaaf4d14-baea-4b32-9461-62e60677444a req-cd4731b2-5278-490f-9a59-b913cfdc17d3 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:46.279691 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-eaaf4d14-baea-4b32-9461-62e60677444a req-cd4731b2-5278-490f-9a59-b913cfdc17d3 service nova] Creating event network-vif-plugged:1abad2f1-426c-4c22-b29e-39bd8fb03553 for instance 0654ac5d-1e96-4e6c-9f82-93887a119738 on hv-cinder-85535 Sep 02 09:11:46.284512 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-eaaf4d14-baea-4b32-9461-62e60677444a req-cd4731b2-5278-490f-9a59-b913cfdc17d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032312 Sep 02 09:11:46.288128 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 259/504] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:46.293444 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-41723629-a3b3-4eb8-b1aa-451bc4260e5f req-5b50d1fe-b48d-4d17-8827-1597fc6abd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66889932-9d4e-49d9-aaed-bf65390e4a7c", "tag": "8201c509-a0f2-4be2-8be7-e498b7469477"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:46.301026 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:46.303005 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-41723629-a3b3-4eb8-b1aa-451bc4260e5f req-5b50d1fe-b48d-4d17-8827-1597fc6abd95 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.303514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-41723629-a3b3-4eb8-b1aa-451bc4260e5f req-5b50d1fe-b48d-4d17-8827-1597fc6abd95 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.303936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-41723629-a3b3-4eb8-b1aa-451bc4260e5f req-5b50d1fe-b48d-4d17-8827-1597fc6abd95 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:46.311147 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-123137b9-f5d3-4026-98eb-7886248056c9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1708 microversion: 2.1 time: 0.783735 Sep 02 09:11:46.320210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 246/505] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:45 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1708 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:46.320210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:46.320210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:46.324824 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-41723629-a3b3-4eb8-b1aa-451bc4260e5f req-5b50d1fe-b48d-4d17-8827-1597fc6abd95 service nova] Creating event network-changed:8201c509-a0f2-4be2-8be7-e498b7469477 for instance 66889932-9d4e-49d9-aaed-bf65390e4a7c on hv-cinder-85535 Sep 02 09:11:46.327973 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.329036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.329543 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:46.330248 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.330789 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.331175 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-41723629-a3b3-4eb8-b1aa-451bc4260e5f req-5b50d1fe-b48d-4d17-8827-1597fc6abd95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041479 Sep 02 09:11:46.331482 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:46.332071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 260/506] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:46.336814 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:46.337507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:46.343901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.344388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.344826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:46.345513 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.345964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.346385 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:46.557997 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:46.559290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:46.570092 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-19854288-c7d6-4211-9607-e15ebc8991fa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1371 microversion: 2.1 time: 0.256865 Sep 02 09:11:46.584796 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 247/507] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:46 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:46.585945 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b802b21c-0b18-4742-9fbc-e0923b4124c6 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.252581 Sep 02 09:11:46.586879 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 261/508] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:46 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:46.590882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:46.591550 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:46.598878 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.599890 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:46.600616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.600737 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:46.601413 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:46.602568 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.603368 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.604170 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:46.626130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.629611 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.630175 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:46.631128 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:46.631694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:46.634206 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.094887 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:47.097887 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:47.103228 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8a1a12c6-48d5-44e4-af71-ecb5ac6bb3a7 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.516224 Sep 02 09:11:47.103948 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 248/509] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:46 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:47.106240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:47.107727 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:47.109104 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cbe73ed3-ddaa-4c4b-840e-765be5c39d52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.520872 Sep 02 09:11:47.109580 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 262/510] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:46 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:47.270495 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:47.271163 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:47.276974 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.277460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.277895 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.278680 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.279246 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.279678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.333277 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:47.333913 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:47.340862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.342131 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.342426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.343235 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.343621 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.344085 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.452681 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:47.460401 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-92a81436-d392-43b0-98b4-075bd2f77fd3 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.194303 Sep 02 09:11:47.461093 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 249/511] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:47 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:47.495559 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:47.504248 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dfccc032-41f0-4048-a4f8-7207df9404f6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1708 microversion: 2.1 time: 0.174805 Sep 02 09:11:47.504820 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 263/512] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:47 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1708 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:47.595466 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:47.596070 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:47.601928 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.602410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.602878 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.603618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.604070 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.604491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.612628 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:47.613252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:47.619773 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.620392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.621088 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.621780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.622405 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.623009 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.939704 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:47.943044 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:47.947508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0c9de348-7d3a-4c14-a3e2-213cb24a643c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1566 microversion: 2.1 time: 0.356020 Sep 02 09:11:47.948120 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 250/513] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:47 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1566 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:47.950962 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a5bc0be7-9360-4345-987b-0b57d442c4a4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.343369 Sep 02 09:11:47.951565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 264/514] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:47 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:47.967458 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4021be94-3c08-4fb6-9555-29506f0a8f9d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:47.967947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4021be94-3c08-4fb6-9555-29506f0a8f9d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:47.974216 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4021be94-3c08-4fb6-9555-29506f0a8f9d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.974717 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4021be94-3c08-4fb6-9555-29506f0a8f9d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.975177 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4021be94-3c08-4fb6-9555-29506f0a8f9d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:47.975861 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4021be94-3c08-4fb6-9555-29506f0a8f9d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:47.976314 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4021be94-3c08-4fb6-9555-29506f0a8f9d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:47.976749 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4021be94-3c08-4fb6-9555-29506f0a8f9d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:48.051810 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4021be94-3c08-4fb6-9555-29506f0a8f9d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088021 Sep 02 09:11:48.052432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 251/515] 10.222.0.36 () {58 vars in 1275 bytes} [Fri Sep 2 09:11:47 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:11:48.124423 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:48.125117 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:48.131694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:48.132137 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:48.132277 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:48.132597 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:48.132952 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:48.133338 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:48.133823 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:48.134280 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:48.139114 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:48.139699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:48.140160 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:48.141474 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:48.141841 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:48.142266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:48.644910 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:48.651133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:48.652928 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:48.654365 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:48.655792 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3993885b-d662-445b-8bef-b32d0c8505f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.528109 Sep 02 09:11:48.658918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6ac7f373-e129-4f29-8c1a-9e30a326411c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.538478 Sep 02 09:11:48.659588 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 265/516] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:48 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:48.664262 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:48.664919 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:48.667241 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 252/517] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:48 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:11:48.667726 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:48.672095 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:48.672573 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:48.673173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:48.674071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:48.674521 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:48.675016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:48.675942 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:48.676587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:48.682682 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:48.683209 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:48.683650 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:48.684362 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:48.684823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:48.685249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:49.003580 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:49.011287 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7235e0b8-e0aa-4ee0-aacd-f5cdd9ba28ea tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.350525 Sep 02 09:11:49.011861 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 266/518] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:48 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:49.016323 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:49.016937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:49.022492 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:49.022975 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:49.023441 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:49.024132 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:49.024585 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:49.025011 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:49.028069 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:49.036530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-362b9323-01ee-4243-b803-0d05d06b1ec7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1708 microversion: 2.1 time: 0.368087 Sep 02 09:11:49.037183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 253/519] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:48 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1708 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:49.242805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:49.250922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bc24e7ff-e922-4836-a5e6-9b906b0cd360 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.237531 Sep 02 09:11:49.251520 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 267/520] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:49 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:49.688020 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:49.689450 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:49.690558 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:49.691697 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:49.706406 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:49.708161 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:49.708874 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:49.709611 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:49.710344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:49.711052 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:49.712100 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:49.712975 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:49.713535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:49.714121 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:49.714655 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:49.715170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:50.059225 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:50.063425 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:50.068855 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:50.070576 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:50.071464 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-932fcfde-463a-47fa-ba71-658a6844bb36 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.394720 Sep 02 09:11:50.072282 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 268/521] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:49 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:11:50.080291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d009d947-8194-4d08-84ff-a2b1afaae24f tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.400839 Sep 02 09:11:50.091290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 254/522] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:49 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:50.091466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-bbd58503-6c37-4fb1-a0b2-e4d3411a8a4b req-fe9fd9b7-92fa-4a52-8f57-c280e782988b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52664c0-7a4e-4477-8873-3323ad3d7b1b", "name": "network-vif-plugged", "status": "completed", "tag": "8b38c879-463d-4f33-a9c3-a823dc481ba6"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:50.096171 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-bbd58503-6c37-4fb1-a0b2-e4d3411a8a4b req-fe9fd9b7-92fa-4a52-8f57-c280e782988b service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:50.096657 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-bbd58503-6c37-4fb1-a0b2-e4d3411a8a4b req-fe9fd9b7-92fa-4a52-8f57-c280e782988b service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:50.097081 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-bbd58503-6c37-4fb1-a0b2-e4d3411a8a4b req-fe9fd9b7-92fa-4a52-8f57-c280e782988b service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:50.103685 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:50.107129 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:50.109878 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-bbd58503-6c37-4fb1-a0b2-e4d3411a8a4b req-fe9fd9b7-92fa-4a52-8f57-c280e782988b service nova] Creating event network-vif-plugged:8b38c879-463d-4f33-a9c3-a823dc481ba6 for instance a52664c0-7a4e-4477-8873-3323ad3d7b1b on hv-cinder-85535 Sep 02 09:11:50.116543 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:50.117063 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:50.117508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:50.118236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:50.118348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-bbd58503-6c37-4fb1-a0b2-e4d3411a8a4b req-fe9fd9b7-92fa-4a52-8f57-c280e782988b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044694 Sep 02 09:11:50.118694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:50.118878 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 269/523] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:50.119143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:50.123781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:50.124463 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:50.131218 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:50.131700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:50.132130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:50.132804 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:50.134188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:50.134610 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:50.315374 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:50.323197 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-74d0e370-cb9f-4a0f-9740-65274092310c tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1314 microversion: 2.1 time: 0.241293 Sep 02 09:11:50.331488 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 255/524] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:50 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:50.331607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:50.331740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-8cf4443e-308e-4e66-8a44-8a32f11dda9a req-b1f56e22-99b4-4b3b-9a5b-4960ccd43ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a43d50-d1ca-449a-82ef-3df6b6fa88b8", "tag": "91ef318d-54a2-4c8e-ab4c-a5d4963d60aa"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:50.338553 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8cf4443e-308e-4e66-8a44-8a32f11dda9a req-b1f56e22-99b4-4b3b-9a5b-4960ccd43ddb service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:50.339081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8cf4443e-308e-4e66-8a44-8a32f11dda9a req-b1f56e22-99b4-4b3b-9a5b-4960ccd43ddb service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:50.339521 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8cf4443e-308e-4e66-8a44-8a32f11dda9a req-b1f56e22-99b4-4b3b-9a5b-4960ccd43ddb service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:50.343317 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-78c6b8ef-9c76-4a87-af0b-774abf6701d7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1712 microversion: 2.1 time: 0.222061 Sep 02 09:11:50.344671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 270/525] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:50 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1712 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:50.350460 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:50.351400 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:50.354205 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-8cf4443e-308e-4e66-8a44-8a32f11dda9a req-b1f56e22-99b4-4b3b-9a5b-4960ccd43ddb service nova] Creating event network-changed:91ef318d-54a2-4c8e-ab4c-a5d4963d60aa for instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 on hv-cinder-85535 Sep 02 09:11:50.360500 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:50.360658 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-8cf4443e-308e-4e66-8a44-8a32f11dda9a req-b1f56e22-99b4-4b3b-9a5b-4960ccd43ddb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035017 Sep 02 09:11:50.360999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:50.361489 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:50.361631 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 256/526] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:50.362209 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:50.362683 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:50.363253 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:50.494428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:50.502140 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-15574d61-2b84-46cf-b44c-a57c64f7c2dc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.156204 Sep 02 09:11:50.502678 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 271/527] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:50 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:51.099125 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:51.100684 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:51.102981 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:51.103679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:51.110462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.111331 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.112020 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.112184 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.112848 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.113449 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.113589 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.114139 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.114776 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.114962 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.115599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.116355 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.436341 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:51.436941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:51.455944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5e3dbfd3-445f-491c-920b-e91e8d47c583 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.356740 Sep 02 09:11:51.458025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:51.458709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 272/528] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:51 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:51.464229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:51.466441 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:51.468122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-027b56d3-89a1-4244-ad55-e6e37909fc26 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.375444 Sep 02 09:11:51.468897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 257/529] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:51 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:51.470404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:51.488701 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.489210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.489651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.490572 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.491037 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.491494 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.523344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:51.523977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:51.530678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.531510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.532015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.532729 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.533212 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.533664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.780556 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:51.791433 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fffcb57a-beb6-47b3-a75d-25bb59d707f2 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1464 microversion: 2.1 time: 0.330359 Sep 02 09:11:51.801676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 273/530] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:51 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:51.842549 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:51.843174 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:51.849945 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.850434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.850873 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.851591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:51.852148 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:51.852755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:51.873725 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:51.882337 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:51.885666 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:11:51.886532 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1b83a221-a024-4e3b-8148-d016b66f601a tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.367621 Sep 02 09:11:51.887775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 258/531] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:51 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:51.963700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:52.041794 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0ad2bf6a-9b5e-4dfd-b509-f77ee72551b5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 204 len: 0 microversion: 2.1 time: 0.203217 Sep 02 09:11:52.042634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 274/532] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:11:51 2022] DELETE /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 09:11:52.051256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:52.051879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:52.058315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:52.058811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:52.059286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:52.059993 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:52.060444 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:52.061095 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:52.270266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:52.277937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f282ce68-35b9-4fe6-b929-bdaef619e018 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1470 microversion: 2.1 time: 0.230835 Sep 02 09:11:52.278510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 259/533] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:52 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:52.481107 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:52.481722 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:52.489767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:52.490266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:52.490709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:52.491450 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:52.491911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:52.492340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:52.493981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:52.494616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:52.500455 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:52.500928 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:52.501356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:52.502034 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:52.502481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:52.502897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:52.698240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:52.704441 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:52.707050 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d6bd4c3b-24ba-41a2-8eb8-904b226b8bb1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.230200 Sep 02 09:11:52.707861 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 275/534] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:52 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:52.715106 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:52.716859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:52.719495 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-69c8ead6-5078-4f85-afb6-1ba1c1bc199a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.228688 Sep 02 09:11:52.720430 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 260/535] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:52 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:11:52.908509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:52.909123 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:52.915026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:52.915534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:52.915964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:52.916648 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:52.917133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:52.917560 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:53.045423 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:53.053545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6066a543-28f0-469b-a4cb-41c62cf6ad66 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.149503 Sep 02 09:11:53.054106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 276/536] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:52 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:53.300720 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:53.301332 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:53.308026 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:53.308520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:53.308960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:53.309690 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:53.310152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:53.310584 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:53.446194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:53.454676 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9f4dcead-82f1-411c-9f5d-d0f2ca6b6439 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1470 microversion: 2.1 time: 0.158368 Sep 02 09:11:53.455471 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 261/537] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:53 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:53.727490 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:53.728135 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:53.736948 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:53.737468 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:53.737909 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:53.738687 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:53.739082 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:53.739516 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:53.744253 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:53.745142 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:53.751620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:53.752312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:53.752519 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:53.753248 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:53.753701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:53.754122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:53.929756 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:53.937371 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b7f4af2-abd1-4b54-ab42-4d7d1cc11715 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.213633 Sep 02 09:11:53.938427 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 277/538] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:53 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:53.943954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:53.952432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:53.954522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:53.955735 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4f1faa96-fa72-4c8e-9fa5-086c4e3ff948 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.217648 Sep 02 09:11:53.956287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 262/539] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:53 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:54.073877 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:54.074533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:54.081272 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:54.081764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:54.082202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:54.082903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:54.083401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:54.083824 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:54.216251 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:54.223866 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5dbc1530-82b3-46dd-a98f-8e49f82d993b tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.153970 Sep 02 09:11:54.224440 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 278/540] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:54 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:54.366880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-27eb8da1-2356-4ed5-9403-8e36fa8942d8 req-454938aa-2584-4107-bd16-88c31b623682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d867d4df-9d60-4213-9895-3583d7914735", "name": "network-vif-plugged", "status": "completed", "tag": "f8ab8844-1efe-4e80-a575-5c63bfe8bdda"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:54.377401 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-27eb8da1-2356-4ed5-9403-8e36fa8942d8 req-454938aa-2584-4107-bd16-88c31b623682 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:54.377943 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-27eb8da1-2356-4ed5-9403-8e36fa8942d8 req-454938aa-2584-4107-bd16-88c31b623682 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:54.378373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-27eb8da1-2356-4ed5-9403-8e36fa8942d8 req-454938aa-2584-4107-bd16-88c31b623682 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:54.390041 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-27eb8da1-2356-4ed5-9403-8e36fa8942d8 req-454938aa-2584-4107-bd16-88c31b623682 service nova] Creating event network-vif-plugged:f8ab8844-1efe-4e80-a575-5c63bfe8bdda for instance d867d4df-9d60-4213-9895-3583d7914735 on hv-cinder-85535 Sep 02 09:11:54.394880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-27eb8da1-2356-4ed5-9403-8e36fa8942d8 req-454938aa-2584-4107-bd16-88c31b623682 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031669 Sep 02 09:11:54.395510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 263/541] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:54.481817 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:54.482589 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:54.502501 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:54.503102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:54.503544 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:54.504317 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:54.504772 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:54.505193 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:54.661217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:54.668651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2068871b-a3fc-449a-8949-44dc4825ab9f tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1470 microversion: 2.1 time: 0.195238 Sep 02 09:11:54.669210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 279/542] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:54 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:54.958268 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:54.958991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:54.965103 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:54.965587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:54.966022 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:54.966706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:54.967192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:54.967618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:54.977577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:54.978391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:54.985192 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:54.985669 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:54.986095 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:54.986776 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:54.987274 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:54.987691 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:55.156544 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:55.164866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9798131a-ba46-42e4-ae2c-5e758e6d147b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.210246 Sep 02 09:11:55.164866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 264/543] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:54 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:55.166853 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:55.175389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:55.176828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:55.177971 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-16e67212-ad73-4ae7-b058-e896c13182cb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1743 microversion: 2.20 time: 0.204206 Sep 02 09:11:55.178517 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 280/544] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:54 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1743 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:11:55.244604 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:55.245140 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:55.247037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:11:55.252896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:55.253380 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:55.253819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:55.254511 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:55.254966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:55.255420 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:55.383934 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:55.392139 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-90f6acac-15b4-4ca3-a7bf-88019db7f724 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1318 microversion: 2.1 time: 0.151377 Sep 02 09:11:55.392727 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 265/545] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:55 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:55.690408 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:55.691021 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:55.697430 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:55.697920 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:55.698413 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:55.699130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:55.699592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:55.700049 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:55.833784 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:55.841856 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-645848e4-e288-48a0-a7bc-ec42afbf55f5 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1470 microversion: 2.1 time: 0.155929 Sep 02 09:11:55.842410 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 281/546] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:55 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:56.185285 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:56.185939 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:56.191811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:56.192296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:56.192725 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:56.193426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:56.193879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:56.194301 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:56.206121 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:56.207266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:56.213991 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:56.214683 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:56.215335 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:56.216230 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:56.216690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:56.217379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:56.645500 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:56.645982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:56.653354 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c1c938e5-d4ac-4617-999d-1afe4e33c393 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.472212 Sep 02 09:11:56.653928 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 266/547] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:56 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:56.654989 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:56.657249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:56.658414 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-56598e17-ec01-411f-b005-bc2786a82e56 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1743 microversion: 2.20 time: 0.460354 Sep 02 09:11:56.660060 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:56.660864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:56.667050 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:56.667749 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:56.668350 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:56.669237 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:56.669851 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:56.670434 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:56.671648 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 282/548] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:56 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1743 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:56.678548 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-a73865b4-268e-46f3-90e2-c0e1d8701ff0 req-f7a0442f-e234-42ad-973e-43ecd632a725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6b1337-6402-4108-aef8-2ad90760a201", "name": "network-vif-plugged", "status": "completed", "tag": "d40e6588-7e5a-43ac-bea3-7b456bc3d155"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:56.688294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a73865b4-268e-46f3-90e2-c0e1d8701ff0 req-f7a0442f-e234-42ad-973e-43ecd632a725 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:56.688996 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a73865b4-268e-46f3-90e2-c0e1d8701ff0 req-f7a0442f-e234-42ad-973e-43ecd632a725 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:56.689429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a73865b4-268e-46f3-90e2-c0e1d8701ff0 req-f7a0442f-e234-42ad-973e-43ecd632a725 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:56.702221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-a73865b4-268e-46f3-90e2-c0e1d8701ff0 req-f7a0442f-e234-42ad-973e-43ecd632a725 service nova] Creating event network-vif-plugged:d40e6588-7e5a-43ac-bea3-7b456bc3d155 for instance 5d6b1337-6402-4108-aef8-2ad90760a201 on hv-cinder-85535 Sep 02 09:11:56.707828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-a73865b4-268e-46f3-90e2-c0e1d8701ff0 req-f7a0442f-e234-42ad-973e-43ecd632a725 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034996 Sep 02 09:11:56.708438 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 283/549] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:56.864027 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:56.864874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:56.870922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:56.871446 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:56.871875 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:56.872608 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:56.873003 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:56.873417 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:56.998589 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:57.006252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-81a5c08e-01b8-4573-af4e-09abcaac71b5 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1506 microversion: 2.1 time: 0.351125 Sep 02 09:11:57.007033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 267/550] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:56 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:57.025849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-682dc697-22fe-4426-9284-b2f2fab770e4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55b8c395-0b01-458c-a000-7e10ea6264ef", "device": "/dev/sdb"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:57.028784 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-682dc697-22fe-4426-9284-b2f2fab770e4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:57.035269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-682dc697-22fe-4426-9284-b2f2fab770e4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:57.035747 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-682dc697-22fe-4426-9284-b2f2fab770e4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:57.036173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-682dc697-22fe-4426-9284-b2f2fab770e4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:57.036856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-682dc697-22fe-4426-9284-b2f2fab770e4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:57.037302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-682dc697-22fe-4426-9284-b2f2fab770e4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:57.037717 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-682dc697-22fe-4426-9284-b2f2fab770e4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:57.106506 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:57.115401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-22266869-0930-481f-8281-6e92b79b3bb0 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1470 microversion: 2.1 time: 0.255571 Sep 02 09:11:57.115980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 284/551] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:56 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1470 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:57.386645 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-6b840d62-42d7-48fc-be5b-b9052adf8ee4 req-1f5891e3-e9a1-45ab-818d-9ce8f1a466da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0654ac5d-1e96-4e6c-9f82-93887a119738", "name": "network-vif-deleted", "tag": "1abad2f1-426c-4c22-b29e-39bd8fb03553"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:11:57.397050 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6b840d62-42d7-48fc-be5b-b9052adf8ee4 req-1f5891e3-e9a1-45ab-818d-9ce8f1a466da service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:57.397527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6b840d62-42d7-48fc-be5b-b9052adf8ee4 req-1f5891e3-e9a1-45ab-818d-9ce8f1a466da service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:57.398125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6b840d62-42d7-48fc-be5b-b9052adf8ee4 req-1f5891e3-e9a1-45ab-818d-9ce8f1a466da service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:57.413591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-6b840d62-42d7-48fc-be5b-b9052adf8ee4 req-1f5891e3-e9a1-45ab-818d-9ce8f1a466da service nova] Creating event network-vif-deleted:1abad2f1-426c-4c22-b29e-39bd8fb03553 for instance 0654ac5d-1e96-4e6c-9f82-93887a119738 on hv-cinder-85535 Sep 02 09:11:57.418650 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-6b840d62-42d7-48fc-be5b-b9052adf8ee4 req-1f5891e3-e9a1-45ab-818d-9ce8f1a466da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035605 Sep 02 09:11:57.419849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 285/552] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:11:57.461883 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-682dc697-22fe-4426-9284-b2f2fab770e4 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "POST /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439623 Sep 02 09:11:57.462794 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 268/553] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:11:57 2022] POST /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:11:57.674182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:57.674878 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:57.681044 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:57.681631 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:57.682069 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:57.682753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:57.683232 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:57.683658 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:57.684867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:57.686040 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:57.695530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:57.696253 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:57.696904 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:57.697944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:57.698677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:57.699351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:57.865649 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:57.873226 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34a2c6f3-2b06-49e4-a356-c3a559f6c603 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.203226 Sep 02 09:11:57.873898 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 286/554] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:57 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:11:57.892403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:57.901185 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:57.902742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:57.903938 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6e412f51-99c2-4f5f-90ad-fe045c3dfa25 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1743 microversion: 2.20 time: 0.223770 Sep 02 09:11:57.904486 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 269/555] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:57 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:11:58.136144 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:58.136758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:58.142874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:58.143296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:58.143735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:58.144420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:58.144878 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:58.145339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:58.211727 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:58.219746 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e91d17bb-9a30-47a3-85fb-a71c06c6d931 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1299 microversion: 2.1 time: 0.087402 Sep 02 09:11:58.220308 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 287/556] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:58 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:58.894014 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:58.894552 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:58.901490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:58.902640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:58.903110 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:58.907319 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:58.908216 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:58.908968 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:58.928307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:58.928918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:58.935731 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:58.936535 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:58.937182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:58.938775 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:58.939419 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:58.939999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:59.104256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:59.112415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-82af8066-1428-419b-8665-d2beae6771c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1259 microversion: 2.1 time: 0.222302 Sep 02 09:11:59.112973 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 270/557] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:58 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:11:59.120349 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:59.128369 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:59.129820 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:59.130968 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3972e2c6-9ccb-46fa-b277-4e8c47e1ed75 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1743 microversion: 2.20 time: 0.207795 Sep 02 09:11:59.131557 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 288/558] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:11:58 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1743 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:11:59.241016 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:11:59.241539 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:11:59.247825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:59.248303 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:59.248728 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:59.249409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:59.249858 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:59.250787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:59.280984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:11:59.281452 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:11:59.281880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:11:59.282317 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lazy-loading 'fault' on Instance uuid 0654ac5d-1e96-4e6c-9f82-93887a119738 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:11:59.322461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:11:59.331138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4c8f6545-3e22-4205-a2a8-4f16a1ad39cc tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1304 microversion: 2.1 time: 0.094141 Sep 02 09:11:59.331708 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 271/559] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:11:59 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:00.133988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:00.134690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:00.141479 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:00.141985 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:00.142394 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:00.143149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:00.143534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:00.143991 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:00.152624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:00.153225 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:00.160990 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:00.161605 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:00.162038 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:00.162896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:00.163385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:00.163972 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:00.349601 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:00.357190 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:00.357380 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d9d1a9c-ab8f-469c-984f-5000fdc51ad2 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1441 microversion: 2.1 time: 0.228462 Sep 02 09:12:00.358011 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 289/560] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:00 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1441 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:00.362383 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:00.363646 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:00.365750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:00.367220 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:00.368515 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b1c1efb-9c12-4641-859d-4740f64a8304 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.219674 Sep 02 09:12:00.369058 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 272/561] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:00 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:12:00.369335 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:00.369812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:00.370247 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:00.370936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:00.371460 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:00.372054 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:00.377442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:00.378049 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:00.384338 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:00.384833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:00.385271 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:00.385969 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:00.386430 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:00.386849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:00.402149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:00.402624 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:00.403054 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:00.403513 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lazy-loading 'fault' on Instance uuid 0654ac5d-1e96-4e6c-9f82-93887a119738 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:12:00.450348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b7b3a759604adcb7be3fe78f998f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8851adb9a8a0495aa7660431a99d5eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:00.458718 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7cd989fc-5892-43c1-b479-c449ec845832 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 200 len: 1304 microversion: 2.1 time: 0.099794 Sep 02 09:12:00.459305 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 290/562] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:00 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:00.544021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:00.555283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3eee4981-23f0-4b0c-9548-f55936e69c88 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1441 microversion: 2.1 time: 0.181281 Sep 02 09:12:00.555843 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 273/563] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:00 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1441 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:12:01.390988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:01.391661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:01.397699 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:01.398515 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:01.399049 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:01.400022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:01.400703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:01.401187 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:01.481213 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:01.482753 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] [instance: 0654ac5d-1e96-4e6c-9f82-93887a119738] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:01.495090 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:01.495954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:01.496619 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:01.497521 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:01.498177 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:01.498789 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:01.515554 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] HTTP exception thrown: Instance 0654ac5d-1e96-4e6c-9f82-93887a119738 could not be found. Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Request method failure captured: Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 HTTP/1.1 Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcizHIDAcPKOK-0kPpJDp2wQaCxc9u5m9wSeSnlwxYuc3Aq78LXKEa4GfpYbfzJwBAdCOzeqKIFcyk7yan1Gp9fpKAJbp-ixtHZ6KUtitPr4F8nbuukPLyFZ7elUlxIys7h6Kx7CwYk_2Nrp-AO960Rnu8G5qvF2V-MMm4XsDumsYKg Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 8851adb9a8a0495aa7660431a99d5eee Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-976793203 Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:12:01.517478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8851adb9a8a0495aa7660431a99d5eee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8851adb9a8a0495aa7660431a99d5eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8851adb9a8a0495aa7660431a99d5eee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8851adb9a8a0495aa7660431a99d5eee", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-976793203 Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 8851adb9a8a0495aa7660431a99d5eee Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-976793203 Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-976793203-project Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: f1b7b3a759604adcb7be3fe78f998f4f Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-976793203-project Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 0654ac5d-1e96-4e6c-9f82-93887a119738 could not be found. Sep 02 09:12:01.518896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '0654ac5d-1e96-4e6c-9f82-93887a119738'} Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0654ac5d-1e96-4e6c-9f82-93887a119738 could not be found. Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:12:01.519740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0654ac5d-1e96-4e6c-9f82-93887a119738 could not be found. Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0654ac5d-1e96-4e6c-9f82-93887a119738 could not be found. Sep 02 09:12:01.520953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:01.523686 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] Returning 404 to user: Instance 0654ac5d-1e96-4e6c-9f82-93887a119738 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:12:01.524774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5141e419-8db5-4497-906e-c3d9b43cf8a6 tempest-VolumesNegativeTest-976793203 tempest-VolumesNegativeTest-976793203-project] 10.222.0.36 "GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738" status: 404 len: 111 microversion: 2.1 time: 0.048387 Sep 02 09:12:01.525907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 274/564] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:01 2022] GET /compute/v2.1/servers/0654ac5d-1e96-4e6c-9f82-93887a119738 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 09:12:01.585182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:01.590474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:01.602639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:01.604477 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:01.605942 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6a17cdd8-1593-4bf0-8545-be8072911d78 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.218935 Sep 02 09:12:01.606976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 291/565] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:01 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:02.629482 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:02.630130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:02.640908 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:02.641583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:02.643006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:02.643891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:02.644501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:02.645076 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:02.651722 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:02.714329 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-9b6c10d3-e68d-473f-a368-9119fc195065 req-24843dea-71d0-41c2-9419-42824c63b248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d867d4df-9d60-4213-9895-3583d7914735", "tag": "f8ab8844-1efe-4e80-a575-5c63bfe8bdda"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:02.732949 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-9b6c10d3-e68d-473f-a368-9119fc195065 req-24843dea-71d0-41c2-9419-42824c63b248 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:02.735020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-9b6c10d3-e68d-473f-a368-9119fc195065 req-24843dea-71d0-41c2-9419-42824c63b248 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:02.737378 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-9b6c10d3-e68d-473f-a368-9119fc195065 req-24843dea-71d0-41c2-9419-42824c63b248 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:02.759352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-9b6c10d3-e68d-473f-a368-9119fc195065 req-24843dea-71d0-41c2-9419-42824c63b248 service nova] Creating event network-changed:f8ab8844-1efe-4e80-a575-5c63bfe8bdda for instance d867d4df-9d60-4213-9895-3583d7914735 on hv-cinder-85535 Sep 02 09:12:02.766872 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-9b6c10d3-e68d-473f-a368-9119fc195065 req-24843dea-71d0-41c2-9419-42824c63b248 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055984 Sep 02 09:12:02.768882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 292/566] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:12:02.871288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:02.881042 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:02.882968 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:02.884351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-45da6989-4459-4f68-a6f3-33610082c22b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.259251 Sep 02 09:12:02.885389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 275/567] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:02 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:03.913900 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:03.915556 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:03.923278 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:03.924131 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:03.924753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:03.925622 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:03.926236 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:03.926816 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:04.140221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:04.163669 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:04.165629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:04.167024 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a35385e7-841a-4744-8ff7-9e07a65c65ad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.260037 Sep 02 09:12:04.167615 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 293/568] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:03 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:05.191006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:05.191675 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:05.198901 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:05.199453 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:05.199895 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:05.200669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:05.201411 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:05.201860 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:05.392236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:05.401517 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:05.402940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:05.404118 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0bdf464e-1feb-4ebc-a79d-fad211013422 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.217713 Sep 02 09:12:05.404806 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 276/569] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:05 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:06.435955 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:06.436614 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:06.452379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:06.452876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:06.453315 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:06.454017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:06.454467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:06.454887 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:06.640271 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:06.648861 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:06.650418 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:06.651692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a32bb752-61de-4ce0-a329-c0a58ef4edc5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.226230 Sep 02 09:12:06.652771 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 294/570] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:06 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:07.679851 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:07.680548 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:07.688707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:07.689463 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:07.690059 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:07.691757 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:07.692377 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:07.692794 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:07.852759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:07.865315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:07.866946 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:07.868255 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a31437eb-38e4-454b-99ef-d984632d3dd7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.192277 Sep 02 09:12:07.882595 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 277/571] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:07 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:08.896409 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:08.896931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:08.903407 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:08.904198 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:08.907088 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:08.908069 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:08.908529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:08.909144 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:09.050420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:09.059171 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:09.060667 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:09.061878 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e88a70c6-01a1-4f5d-b6c8-76f98898e79d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.169607 Sep 02 09:12:09.062951 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 295/572] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:08 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:10.085494 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:10.086069 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:10.093237 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:10.094645 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:10.095199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:10.095900 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:10.096377 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:10.096775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:10.233032 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:10.241871 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:10.243345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:10.244726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a8fd6bb6-347f-4364-b978-c42d33ac733b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.163091 Sep 02 09:12:10.245274 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 278/573] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:10 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:11.269925 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:11.270479 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:11.276833 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:11.277316 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:11.277748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:11.278431 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:11.278886 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:11.279332 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:11.409898 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:11.417759 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:11.419227 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:11.420434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5199958e-8a5e-4571-8174-782177e07230 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1738 microversion: 2.20 time: 0.154403 Sep 02 09:12:11.420989 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 296/574] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:11 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:12.442479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:12.443152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:12.449739 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:12.450222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:12.450657 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:12.451639 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:12.452095 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:12.452519 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:12.579871 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:12.587886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:12.589310 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:12.590440 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2925f4e3-83ac-464a-baa1-eec84079dcf8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1720 microversion: 2.20 time: 0.152522 Sep 02 09:12:12.591030 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 279/575] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:12 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:13.613855 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:13.614387 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:13.620833 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:13.621311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:13.621742 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:13.622425 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:13.622872 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:13.623312 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:13.749584 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:13.758030 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:13.759490 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:13.760632 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d361752b-1795-47c4-aaf2-3a5862a4df50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1720 microversion: 2.20 time: 0.150760 Sep 02 09:12:13.761183 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 297/576] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:13 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:14.783870 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:14.784599 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:14.790855 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:14.791369 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:14.791803 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:14.792489 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:14.792940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:14.793399 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:14.924293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:14.935048 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:14.936682 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:14.937857 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8a376950-a64a-4427-85b6-49442a670695 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1720 microversion: 2.20 time: 0.158584 Sep 02 09:12:14.938403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 280/577] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:14 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:15.960103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:15.960672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:15.966994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:15.967514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:15.967947 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:15.968636 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:15.969075 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:15.969490 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:16.096772 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:16.104744 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:16.106158 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:16.107321 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-27ba8cd4-bc77-4201-9899-8dfd95c21b96 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1720 microversion: 2.20 time: 0.151165 Sep 02 09:12:16.107872 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 298/578] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:15 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:17.130353 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:17.130961 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:17.137352 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:17.137827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:17.138261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:17.138940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:17.139420 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:17.139838 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:17.172359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-e1d5c049-c2d4-44c4-90d4-d1c139e7f08b req-ea50551a-8242-4a17-a7d0-9f18239a1258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6b1337-6402-4108-aef8-2ad90760a201", "name": "network-vif-unplugged", "status": "completed", "tag": "d40e6588-7e5a-43ac-bea3-7b456bc3d155"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:17.188877 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e1d5c049-c2d4-44c4-90d4-d1c139e7f08b req-ea50551a-8242-4a17-a7d0-9f18239a1258 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:17.189226 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e1d5c049-c2d4-44c4-90d4-d1c139e7f08b req-ea50551a-8242-4a17-a7d0-9f18239a1258 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:17.189903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e1d5c049-c2d4-44c4-90d4-d1c139e7f08b req-ea50551a-8242-4a17-a7d0-9f18239a1258 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:17.204767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-e1d5c049-c2d4-44c4-90d4-d1c139e7f08b req-ea50551a-8242-4a17-a7d0-9f18239a1258 service nova] Creating event network-vif-unplugged:d40e6588-7e5a-43ac-bea3-7b456bc3d155 for instance 5d6b1337-6402-4108-aef8-2ad90760a201 on hv-cinder-85535 Sep 02 09:12:17.210037 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-e1d5c049-c2d4-44c4-90d4-d1c139e7f08b req-ea50551a-8242-4a17-a7d0-9f18239a1258 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041232 Sep 02 09:12:17.211010 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 299/579] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:12:17.292938 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:17.301024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:17.302450 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:17.303630 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b005ad68-8141-4be3-8b5e-6b83d8daf5f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1720 microversion: 2.20 time: 0.177255 Sep 02 09:12:17.304183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 281/580] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:17 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:12:18.329167 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:18.329979 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:18.336650 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:18.337069 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:18.337502 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:18.338183 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:18.338634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:18.339050 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:18.476708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:18.484700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:18.486131 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:18.487301 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9fdbbf55-e074-4620-8bd3-c70c307b0390 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1663 microversion: 2.20 time: 0.163856 Sep 02 09:12:18.487850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 300/581] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:18 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:18.509731 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-361a6ffd-7cf5-4a10-87a9-6e1367795860 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6ceb41b-5361-43bc-aabb-4f9b38a6aa59"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:18.512151 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-361a6ffd-7cf5-4a10-87a9-6e1367795860 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:18.519099 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-361a6ffd-7cf5-4a10-87a9-6e1367795860 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:18.519587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-361a6ffd-7cf5-4a10-87a9-6e1367795860 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:18.520017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-361a6ffd-7cf5-4a10-87a9-6e1367795860 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:18.520697 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-361a6ffd-7cf5-4a10-87a9-6e1367795860 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:18.521149 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-361a6ffd-7cf5-4a10-87a9-6e1367795860 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:18.521572 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-361a6ffd-7cf5-4a10-87a9-6e1367795860 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:18.793485 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-361a6ffd-7cf5-4a10-87a9-6e1367795860 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287544 Sep 02 09:12:18.794077 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 282/582] 10.222.0.36 () {62 vars in 1364 bytes} [Fri Sep 2 09:12:18 2022] POST /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:12:18.913916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:18.914498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:18.916430 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:18.922960 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:18.923468 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:18.923906 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:18.924591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:18.925048 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:18.925471 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:18.967229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120573) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 09:12:19.031736 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9e088063-f325-4b00-9c80-8f15d4c3214f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/action" status: 202 len: 0 microversion: 2.20 time: 0.121583 Sep 02 09:12:19.032327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 301/583] 10.222.0.36 () {62 vars in 1319 bytes} [Fri Sep 2 09:12:18 2022] POST /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:19.040398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:19.041004 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:19.047870 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:19.048352 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:19.048780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:19.049464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:19.049915 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:19.050338 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:19.182620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:19.193267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:19.195038 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:19.195934 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2ebc51a-115f-4e1b-b309-f79c2829ca8c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1749 microversion: 2.20 time: 0.159351 Sep 02 09:12:19.196791 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 283/584] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:19 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:19.210937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:19.211471 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:19.217286 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:19.217762 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:19.218192 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:19.218907 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:19.219381 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:19.219799 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:19.344979 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lazy-loading 'services' on Instance uuid a52664c0-7a4e-4477-8873-3323ad3d7b1b {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:12:19.470033 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-40f93170-fe7b-4e10-9142-d06b7cf78d71 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b/os-volume_attachments/55b8c395-0b01-458c-a000-7e10ea6264ef" status: 202 len: 0 microversion: 2.1 time: 0.261539 Sep 02 09:12:19.470944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 302/585] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:12:19 2022] DELETE /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b/os-volume_attachments/55b8c395-0b01-458c-a000-7e10ea6264ef => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:12:20.219427 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:20.220046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:20.226452 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:20.226934 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:20.227401 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:20.228093 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:20.228549 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:20.228975 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:20.371757 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:20.383632 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:20.385419 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:20.387443 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-27643881-26ac-48dd-95f0-5d77af482c5a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1751 microversion: 2.20 time: 0.171393 Sep 02 09:12:20.388227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 284/586] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:20 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:21.413033 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:21.413762 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:21.419966 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:21.420485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:21.421018 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:21.421729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:21.422237 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:21.422729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:21.558624 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:21.567870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:21.569313 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:21.570466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9b118a77-fb5b-48f1-8e42-4f872378c24d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1751 microversion: 2.20 time: 0.162275 Sep 02 09:12:21.571015 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 303/587] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:21 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:21.666274 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:21.666789 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:21.673146 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:21.673631 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:21.674094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:21.674780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:21.675267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:21.675721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:21.701456 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:12:21.779922 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c6d5fcd1-8b53-49fa-a880-a6c019fdcfbc tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 204 len: 0 microversion: 2.1 time: 0.117018 Sep 02 09:12:21.781411 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 285/588] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:12:21 2022] DELETE /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:21.789460 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:21.790162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:21.796359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:21.796959 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:21.797466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:21.798231 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:21.798756 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:21.799410 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:21.926599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:21.934098 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b33e094e-514c-450c-b0ae-00cc10249d28 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1512 microversion: 2.1 time: 0.148549 Sep 02 09:12:21.934660 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 304/589] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:21 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:22.594726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:22.595462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:22.601309 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:22.601790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:22.602219 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:22.602900 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:22.603373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:22.603794 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:22.732059 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:22.740957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:22.742381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:22.743706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8dc18e54-5a3d-4db8-9f1a-3dc79a295c13 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.153707 Sep 02 09:12:22.744263 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 286/590] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:22 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:22.956039 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:22.956616 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:22.962960 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:22.963475 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:22.963915 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:22.964609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:22.965064 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:22.965492 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:23.089786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:23.097303 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3a75f4f4-1fe7-4038-93b8-5b1b98384b98 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1512 microversion: 2.1 time: 0.145996 Sep 02 09:12:23.097881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 305/591] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:22 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:23.765718 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:23.766325 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:23.772589 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:23.773068 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:23.773498 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:23.774179 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:23.774639 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:23.775062 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:23.792085 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:23.905502 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:23.914481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:23.915963 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:23.917106 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4a5b358b-0bd9-4bb5-a7f5-0cc9cb9ebb27 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.155230 Sep 02 09:12:23.917660 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 287/592] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:23 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:24.117784 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:24.118481 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:24.124993 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:24.125483 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:24.125913 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:24.126598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:24.127047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:24.127490 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:24.306306 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:24.314508 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a22e333a-a51e-44b3-b5b2-ca396a9aabf9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1512 microversion: 2.1 time: 0.200568 Sep 02 09:12:24.315155 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 306/593] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:24 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:24.864251 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-06e9035d-4cf4-4ba1-9c03-86a1c3cdaa0d req-1e39ae89-5be5-4c56-b333-dc3254f9ec90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52664c0-7a4e-4477-8873-3323ad3d7b1b", "name": "network-vif-deleted", "tag": "8b38c879-463d-4f33-a9c3-a823dc481ba6"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:24.875804 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-06e9035d-4cf4-4ba1-9c03-86a1c3cdaa0d req-1e39ae89-5be5-4c56-b333-dc3254f9ec90 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:24.876275 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-06e9035d-4cf4-4ba1-9c03-86a1c3cdaa0d req-1e39ae89-5be5-4c56-b333-dc3254f9ec90 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:24.876698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-06e9035d-4cf4-4ba1-9c03-86a1c3cdaa0d req-1e39ae89-5be5-4c56-b333-dc3254f9ec90 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:24.889609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-06e9035d-4cf4-4ba1-9c03-86a1c3cdaa0d req-1e39ae89-5be5-4c56-b333-dc3254f9ec90 service nova] Creating event network-vif-deleted:8b38c879-463d-4f33-a9c3-a823dc481ba6 for instance a52664c0-7a4e-4477-8873-3323ad3d7b1b on hv-cinder-85535 Sep 02 09:12:24.896638 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-06e9035d-4cf4-4ba1-9c03-86a1c3cdaa0d req-1e39ae89-5be5-4c56-b333-dc3254f9ec90 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036457 Sep 02 09:12:24.897247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 288/594] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:12:24.940705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:24.941388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:24.948382 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:24.948981 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:24.949530 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:24.950367 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:24.950987 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:24.951726 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:25.155988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:25.165343 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:25.166918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:25.168263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c6c4cdc5-ff05-4f84-89f3-952cbec5ce2c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.232161 Sep 02 09:12:25.168892 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 307/595] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:24 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:25.336123 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:25.336786 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:25.341639 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:25.344501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:25.344981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:25.345410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:25.346102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:25.346548 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:25.346968 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:25.380131 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:25.380609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:25.381039 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:25.381478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lazy-loading 'fault' on Instance uuid a52664c0-7a4e-4477-8873-3323ad3d7b1b {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:12:25.433974 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1daf1c8526245a9854f9b8672fa4222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7c3487e204650adc69b55ef3feb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:25.442008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9283a735-8be6-4c07-a812-dbe5090b0054 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 200 len: 1308 microversion: 2.1 time: 0.110137 Sep 02 09:12:25.442573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 289/596] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:25 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:26.193092 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:26.193703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:26.200520 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:26.201231 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:26.202082 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:26.202977 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:26.203636 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:26.204223 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:26.208921 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:26.408196 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:26.417753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:26.419791 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:26.421125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1ecbd228-533b-421d-8f6b-2d6e7e767a66 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.232017 Sep 02 09:12:26.437296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 308/597] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:26 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:26.464152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:26.465481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] [instance: a52664c0-7a4e-4477-8873-3323ad3d7b1b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:26.473996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:26.474483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:26.474916 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:26.475645 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:26.476096 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:26.476719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:26.490355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] HTTP exception thrown: Instance a52664c0-7a4e-4477-8873-3323ad3d7b1b could not be found. Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Request method failure captured: Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b HTTP/1.1 Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEchK306ohkuMCgGW7cBCdk0Vr4viisiCKIF9vpimHyjUf9wtGRs-86m8cwMg9KjGdzVj1DTf9QJbfTQnfclm__y-RN-AsTjjEFksBCpcP8533_Rau1hYwRtCibKUCyX2-ZLkLRMsYhYMgO4HUfs9_MjCMmRXYVJp-3pQSL62GU19FjY Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 85a7c3487e204650adc69b55ef3feb66 Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1873986334 Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:12:26.492143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85a7c3487e204650adc69b55ef3feb66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a7c3487e204650adc69b55ef3feb66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a7c3487e204650adc69b55ef3feb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85a7c3487e204650adc69b55ef3feb66", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotTestJSON-1873986334 Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 85a7c3487e204650adc69b55ef3feb66 Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1873986334 Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotTestJSON-1873986334-project Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: e1daf1c8526245a9854f9b8672fa4222 Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotTestJSON-1873986334-project Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance a52664c0-7a4e-4477-8873-3323ad3d7b1b could not be found. Sep 02 09:12:26.493795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': 'a52664c0-7a4e-4477-8873-3323ad3d7b1b'} Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52664c0-7a4e-4477-8873-3323ad3d7b1b could not be found. Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:12:26.494706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52664c0-7a4e-4477-8873-3323ad3d7b1b could not be found. Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52664c0-7a4e-4477-8873-3323ad3d7b1b could not be found. Sep 02 09:12:26.496217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:26.497550 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] Returning 404 to user: Instance a52664c0-7a4e-4477-8873-3323ad3d7b1b could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:12:26.497550 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-452d4cfe-5f4a-473f-b48b-d0d7e928e6e9 tempest-VolumesSnapshotTestJSON-1873986334 tempest-VolumesSnapshotTestJSON-1873986334-project] 10.222.0.36 "GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b" status: 404 len: 111 microversion: 2.1 time: 0.033984 Sep 02 09:12:26.497550 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 290/598] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:26 2022] GET /compute/v2.1/servers/a52664c0-7a4e-4477-8873-3323ad3d7b1b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:12:27.444784 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:27.445395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:27.452135 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:27.452618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:27.453063 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:27.453749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:27.454204 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:27.454628 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:27.592222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:27.601793 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:27.603285 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:27.604464 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-203863ea-a268-446c-a14e-ffeb91b82a47 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.163590 Sep 02 09:12:27.605024 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 309/599] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:27 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:28.627094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:28.628170 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:28.637966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:28.638447 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:28.638878 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:28.639613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:28.640061 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:28.640481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:28.777475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:28.786989 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:28.789009 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:28.789683 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dc9d2d83-6146-4511-b7bc-52db81974dad tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.166444 Sep 02 09:12:28.803048 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 291/600] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:28 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:29.812080 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:29.812807 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:29.820598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:29.821449 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:29.822113 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:29.823047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:29.823837 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:29.824476 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:29.968058 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:29.977193 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:29.978639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:29.979833 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eb8704b7-ab0e-4857-bc74-516bc4d9afb4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.171733 Sep 02 09:12:29.980391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 310/601] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:29 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:31.005741 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:31.007496 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:31.015295 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:31.015996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:31.016494 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:31.017260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:31.017804 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:31.018317 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:31.156937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:31.165348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:31.166769 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:31.167959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-294ab3a7-eae5-4c23-80df-4d54b1d6aad0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.168203 Sep 02 09:12:31.168487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 292/602] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:30 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:32.191507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:32.192202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:32.200078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:32.200909 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:32.201912 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:32.202630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:32.203759 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:32.204314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:32.374635 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:32.385305 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:32.394779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:32.398629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b21d1f46-ec0c-46b7-887c-0f250c9ccd42 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.210930 Sep 02 09:12:32.403700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 311/603] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:32 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:33.426008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:33.426660 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:33.432662 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:33.433171 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:33.433602 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:33.434285 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:33.434744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:33.435343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:33.576043 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:33.586193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:33.588309 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:33.589948 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6a4c5262-90e0-40bf-af4b-c8e312de5358 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.167629 Sep 02 09:12:33.590243 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 293/604] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:33 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:34.613043 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:34.613693 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:34.620817 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:34.621299 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:34.621725 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:34.622663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:34.623142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:34.623562 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:34.759854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:34.769102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:34.770539 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:34.771735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b5540f53-cfb9-4cc7-a948-68ecbb911cf4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.163205 Sep 02 09:12:34.772293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 312/605] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:34 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:35.795375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:35.796174 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:35.803508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:35.803985 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:35.804423 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:35.805130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:35.805589 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:35.806057 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:35.944306 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:35.953176 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:35.954548 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:35.955720 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-11d298e7-6828-4d71-9b23-89a407a6655b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.164485 Sep 02 09:12:35.956288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 294/606] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:35 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:36.979038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:36.979649 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:36.985931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:36.986409 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:36.986840 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:36.987554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:36.988010 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:36.988432 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:37.112566 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:37.120994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:37.122460 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:37.123651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1e3d988f-23a0-4cee-a79a-fe55539b7da0 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.148580 Sep 02 09:12:37.124215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 313/607] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:36 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:38.145862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:38.146482 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:38.152949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:38.153437 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:38.153873 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:38.154559 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:38.155046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:38.155490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:38.280035 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:38.288989 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:38.290422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:38.291608 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a24a0486-be6f-42f1-b195-d91ec573aaaf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.149782 Sep 02 09:12:38.292161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 295/608] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:38 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:39.315218 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:39.315826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:39.322255 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:39.322736 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:39.323210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:39.323903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:39.324386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:39.324811 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:39.457010 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:39.465461 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:39.466886 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:39.468077 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-15633e1d-58e4-4997-a9b2-d3564f9549e4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.157405 Sep 02 09:12:39.468634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 314/609] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:39 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:40.489492 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:40.490096 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:40.496617 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:40.497093 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:40.497638 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:40.498328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:40.498777 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:40.499418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:40.630260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:40.638811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:40.640288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:40.641979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1ba0b212-24c7-4c7e-bee4-48564fea37de tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.156278 Sep 02 09:12:40.642541 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 296/610] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:40 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:40.816824 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e526bb04-3aa4-479c-a1e6-2f779340444d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:40.817473 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e526bb04-3aa4-479c-a1e6-2f779340444d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:40.824203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e526bb04-3aa4-479c-a1e6-2f779340444d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:40.824742 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e526bb04-3aa4-479c-a1e6-2f779340444d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:40.825314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e526bb04-3aa4-479c-a1e6-2f779340444d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:40.826037 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e526bb04-3aa4-479c-a1e6-2f779340444d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:40.826503 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e526bb04-3aa4-479c-a1e6-2f779340444d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:40.827244 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e526bb04-3aa4-479c-a1e6-2f779340444d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:40.849905 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e526bb04-3aa4-479c-a1e6-2f779340444d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c/ips" status: 200 len: 151 microversion: 2.1 time: 0.037562 Sep 02 09:12:40.850461 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 315/611] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:12:40 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:12:40.863060 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c15f2e4-9ad3-45cc-87ce-dac04449f47b"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:40.865456 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:40.871243 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:40.871718 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:40.872147 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:40.872849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:40.873296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:40.873710 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:40.951346 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Invalid volume: volume 4c15f2e4-9ad3-45cc-87ce-dac04449f47b is already attached to instances: 6d27c557-5d34-45da-93ea-f6c2a86a807e Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c/os-volume_attachments HTTP/1.1 Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 74 Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:12:40.953252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {"volumeAttachment": {"volumeId": "4c15f2e4-9ad3-45cc-87ce-dac04449f47b"}} Sep 02 09:12:40.954822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Invalid volume: volume 4c15f2e4-9ad3-45cc-87ce-dac04449f47b is already attached to instances: 6d27c557-5d34-45da-93ea-f6c2a86a807e Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'server_id': '66889932-9d4e-49d9-aaed-bf65390e4a7c', 'body': {'volumeAttachment': {'volumeId': '4c15f2e4-9ad3-45cc-87ce-dac04449f47b'}}} Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4c15f2e4-9ad3-45cc-87ce-dac04449f47b is already attached to instances: 6d27c557-5d34-45da-93ea-f6c2a86a807e Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:40.955778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4c15f2e4-9ad3-45cc-87ce-dac04449f47b is already attached to instances: 6d27c557-5d34-45da-93ea-f6c2a86a807e Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:40.957184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:40.958607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:40.958607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:12:40.958607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:12:40.958607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4c15f2e4-9ad3-45cc-87ce-dac04449f47b is already attached to instances: 6d27c557-5d34-45da-93ea-f6c2a86a807e Sep 02 09:12:40.958607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:12:40.958607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 400 to user: Invalid volume: volume 4c15f2e4-9ad3-45cc-87ce-dac04449f47b is already attached to instances: 6d27c557-5d34-45da-93ea-f6c2a86a807e {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:12:40.958607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cd9b3fa2-0a3d-4b28-bb1b-c394093be4ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096165 Sep 02 09:12:40.958607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 297/612] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:12:40 2022] POST /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:12:40.967524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:40.968019 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:40.973900 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:40.974379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:40.974813 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:40.975531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:40.975984 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:40.976408 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:41.001221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:12:41.073899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9ecb195f-a3c3-4a85-9450-856d27fea0a3 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 204 len: 0 microversion: 2.1 time: 0.109882 Sep 02 09:12:41.074467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 316/613] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:12:40 2022] DELETE /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:12:41.082827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:41.083475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:41.089325 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:41.089809 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:41.090620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:41.091345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:41.091801 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:41.092348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:41.223899 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:41.231439 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9eca3b6f-255c-4d82-ad32-71376fc59ba6 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1681 microversion: 2.1 time: 0.152386 Sep 02 09:12:41.231992 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 298/614] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:41 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:41.664976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:41.665713 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:41.671517 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:41.671994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:41.672423 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:41.673099 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:41.673549 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:41.673972 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:41.799821 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:41.808387 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:41.809823 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:41.810988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3e304139-bf91-4e5b-9e04-5856a004e0bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.150259 Sep 02 09:12:41.811564 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 317/615] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:41 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:42.252903 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:42.253441 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:42.260009 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:42.260554 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:42.260984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:42.261663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:42.262110 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:42.262535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:42.394390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:42.402156 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-89e8faf7-4a2a-45c6-9ff9-4b214ce25a88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1681 microversion: 2.1 time: 0.153851 Sep 02 09:12:42.402720 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 299/616] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:42 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:42.834220 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:42.834825 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:42.841210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:42.841721 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:42.842153 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:42.842837 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:42.843325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:42.844252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:42.969619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:42.978012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:42.979468 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:42.980628 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ed7b2c0-af94-4348-b65f-a9d9a7eb46af tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.150465 Sep 02 09:12:42.981182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 318/617] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:42 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:43.423539 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:43.424110 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:43.430517 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:43.431005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:43.431478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:43.432170 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:43.432631 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:43.433056 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:43.559381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:43.567440 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a81b505c-faae-4a1d-ae66-07233024c47d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1681 microversion: 2.1 time: 0.147734 Sep 02 09:12:43.568111 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 300/618] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:43 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:44.003666 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:44.004209 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:44.010392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:44.010877 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:44.011353 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:44.012040 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:44.012497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:44.012921 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:44.255664 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:44.264171 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:44.265606 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:44.266772 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3a8be99e-6c48-4994-b4c0-28a438d0a1d3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.267920 Sep 02 09:12:44.267351 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 319/619] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:43 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:44.589776 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:44.590469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:44.597423 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:44.597904 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:44.598341 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:44.599144 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:44.599596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:44.600015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:44.692192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:44.705550 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-808cf9e3-15d8-4b3e-a383-abd78f6488d4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1614 microversion: 2.1 time: 0.119747 Sep 02 09:12:44.712345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 301/620] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:44 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:44.717533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c09ebd0a-04ac-4db2-b49d-6a02974b5399 req-82fd2ee3-8f43-4ccc-a796-9f8bf98903b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66889932-9d4e-49d9-aaed-bf65390e4a7c", "name": "network-vif-deleted", "tag": "8201c509-a0f2-4be2-8be7-e498b7469477"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:44.733049 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c09ebd0a-04ac-4db2-b49d-6a02974b5399 req-82fd2ee3-8f43-4ccc-a796-9f8bf98903b1 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:44.733611 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c09ebd0a-04ac-4db2-b49d-6a02974b5399 req-82fd2ee3-8f43-4ccc-a796-9f8bf98903b1 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:44.734112 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c09ebd0a-04ac-4db2-b49d-6a02974b5399 req-82fd2ee3-8f43-4ccc-a796-9f8bf98903b1 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:44.745484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c09ebd0a-04ac-4db2-b49d-6a02974b5399 req-82fd2ee3-8f43-4ccc-a796-9f8bf98903b1 service nova] Creating event network-vif-deleted:8201c509-a0f2-4be2-8be7-e498b7469477 for instance 66889932-9d4e-49d9-aaed-bf65390e4a7c on hv-cinder-85535 Sep 02 09:12:44.751870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c09ebd0a-04ac-4db2-b49d-6a02974b5399 req-82fd2ee3-8f43-4ccc-a796-9f8bf98903b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049593 Sep 02 09:12:44.753011 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 320/621] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:12:45.289653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:45.290269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:45.297576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:45.298405 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:45.298860 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:45.299702 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:45.301287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:45.301899 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:45.465420 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:45.475722 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:45.477234 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:45.478415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0109c333-a3a9-4f95-b8f4-c29419fa42f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.192774 Sep 02 09:12:45.492302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 302/622] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:45 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:45.728834 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:45.729714 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:45.736729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:45.737321 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:45.737828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:45.738607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:45.739189 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:45.739709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:45.775385 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:45.775983 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:45.776491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:45.777023 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lazy-loading 'fault' on Instance uuid 66889932-9d4e-49d9-aaed-bf65390e4a7c {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:12:45.822479 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:45.832120 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7164aee4-6022-41a1-aa86-c8112ce943e8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 200 len: 1330 microversion: 2.1 time: 0.107920 Sep 02 09:12:45.832797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 321/623] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:45 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:46.501785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:46.502399 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:46.509940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:46.510422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:46.511055 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:46.511771 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:46.512384 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:46.512989 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:46.731587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:46.740695 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:46.742954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:46.744608 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6b055d74-b363-4601-b319-f2f9b49e5c04 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.247597 Sep 02 09:12:46.745190 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 303/624] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:46 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:46.853556 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:46.854257 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:46.860705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:46.861263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:46.861857 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:46.862715 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:46.863142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:46.863950 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:46.877713 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c HTTP/1.1 Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:12:46.879310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:12:46.880862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '66889932-9d4e-49d9-aaed-bf65390e4a7c'} Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:12:46.881705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:12:46.882926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:46.884146 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:12:46.884146 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e35347ed-c42a-48a0-9717-704614226bea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 404 len: 111 microversion: 2.1 time: 0.031433 Sep 02 09:12:46.884146 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 322/625] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:46 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:12:46.889869 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-34696008-cd0b-42f8-9335-29a18ae7a463 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '.version_select at 0x7f54bc42e430>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:46.910501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-34696008-cd0b-42f8-9335-29a18ae7a463 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441634133" status: 202 len: 0 microversion: 2.1 time: 0.024563 Sep 02 09:12:46.911105 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 304/626] 10.222.0.36 () {58 vars in 1218 bytes} [Fri Sep 2 09:12:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441634133 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:12:47.768681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:47.769511 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:47.777461 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:47.778224 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:47.778901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:47.779849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:47.780533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:47.781687 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:48.094276 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:48.103173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:48.104604 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:48.106208 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-43d6fdaf-3fab-483e-9c8f-c08c885dbb83 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.342043 Sep 02 09:12:48.106707 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 323/627] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:47 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:48.117269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:48.117766 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:48.124483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:48.125579 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:48.126019 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:48.126739 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:48.127269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:48.127732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:48.207354 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lazy-loading 'services' on Instance uuid 6d27c557-5d34-45da-93ea-f6c2a86a807e {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:12:48.210844 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:48.284694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4b4185ea-f78a-48c5-87ae-2f5f0037b653 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments/4c15f2e4-9ad3-45cc-87ce-dac04449f47b" status: 202 len: 0 microversion: 2.1 time: 0.171788 Sep 02 09:12:48.285336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 305/628] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:12:48 2022] DELETE /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments/4c15f2e4-9ad3-45cc-87ce-dac04449f47b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:12:48.293729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-01bafb18-b87a-482b-bbce-a4fbc3904933 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:48.296128 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-01bafb18-b87a-482b-bbce-a4fbc3904933 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:48.303151 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bafb18-b87a-482b-bbce-a4fbc3904933 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:48.303644 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bafb18-b87a-482b-bbce-a4fbc3904933 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:48.304155 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bafb18-b87a-482b-bbce-a4fbc3904933 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:48.305038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bafb18-b87a-482b-bbce-a4fbc3904933 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:48.305497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bafb18-b87a-482b-bbce-a4fbc3904933 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:48.305922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bafb18-b87a-482b-bbce-a4fbc3904933 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:48.322943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:48.340035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-01bafb18-b87a-482b-bbce-a4fbc3904933 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050306 Sep 02 09:12:48.340601 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 324/629] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:12:48 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:12:49.130202 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:49.130917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:49.137276 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:49.137751 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:49.138181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:49.138857 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:49.139343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:49.139765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:49.285073 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:49.293570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:49.295006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:49.296185 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-74da460e-e9f1-4bdc-be6f-74961cca4c1e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.171261 Sep 02 09:12:49.296798 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 306/630] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:49 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:49.359994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bcc6c8e1-7897-4c0a-9de7-dcb5d5be9138 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:49.362686 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bcc6c8e1-7897-4c0a-9de7-dcb5d5be9138 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:49.364696 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:49.370250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc6c8e1-7897-4c0a-9de7-dcb5d5be9138 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:49.371312 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc6c8e1-7897-4c0a-9de7-dcb5d5be9138 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:49.371858 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc6c8e1-7897-4c0a-9de7-dcb5d5be9138 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:49.372571 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc6c8e1-7897-4c0a-9de7-dcb5d5be9138 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:49.373034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc6c8e1-7897-4c0a-9de7-dcb5d5be9138 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:49.373464 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc6c8e1-7897-4c0a-9de7-dcb5d5be9138 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:49.405606 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bcc6c8e1-7897-4c0a-9de7-dcb5d5be9138 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056367 Sep 02 09:12:49.410658 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 325/631] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:12:49 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:12:49.453289 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:49.454141 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:49.460627 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:49.461557 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:49.462495 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:49.463360 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:49.464072 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:49.464644 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:49.552145 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lazy-loading 'services' on Instance uuid 06c2d542-631f-4763-84db-ce759de2b8d8 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:12:49.624633 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7c2f9692-68a9-4cc2-a009-8ae7e06c4485 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/os-volume_attachments/15d96998-0f19-4011-a32b-bd5d7bc97693" status: 202 len: 0 microversion: 2.1 time: 0.175386 Sep 02 09:12:49.625752 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 307/632] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:12:49 2022] DELETE /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/os-volume_attachments/15d96998-0f19-4011-a32b-bd5d7bc97693 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:12:50.318629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:50.319181 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:50.324901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.325382 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.325808 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.326487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.327211 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.328221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.420119 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-30e644a3-6c57-4270-85b9-057d36de22a2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:50.422591 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-30e644a3-6c57-4270-85b9-057d36de22a2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:50.429742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30e644a3-6c57-4270-85b9-057d36de22a2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.430312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30e644a3-6c57-4270-85b9-057d36de22a2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.430843 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30e644a3-6c57-4270-85b9-057d36de22a2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.431634 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30e644a3-6c57-4270-85b9-057d36de22a2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.432161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30e644a3-6c57-4270-85b9-057d36de22a2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.432690 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30e644a3-6c57-4270-85b9-057d36de22a2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.466406 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-30e644a3-6c57-4270-85b9-057d36de22a2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052028 Sep 02 09:12:50.467292 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 308/633] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:12:50 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 09:12:50.529421 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:50.529919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:50.536591 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.537305 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.537736 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.538422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.538872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.539329 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.565018 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:12:50.590883 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:50.600531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:50.602304 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:50.603700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf4776eb-cfba-4c6d-9772-2572b661b801 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.289001 Sep 02 09:12:50.604741 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 326/634] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:50 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:50.649472 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06e8f6d6-456b-4a34-baf0-fce5bdf5dfea tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 204 len: 0 microversion: 2.1 time: 0.123284 Sep 02 09:12:50.650194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 309/635] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:12:50 2022] DELETE /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 09:12:50.665506 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:50.667051 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:50.673748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.675136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.675748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.676617 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.677229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.677823 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.770578 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d93c8d60-12db-4a4f-bbaa-2778e8636cc6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:50.776517 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d93c8d60-12db-4a4f-bbaa-2778e8636cc6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.777193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d93c8d60-12db-4a4f-bbaa-2778e8636cc6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.777621 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d93c8d60-12db-4a4f-bbaa-2778e8636cc6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.801935 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d93c8d60-12db-4a4f-bbaa-2778e8636cc6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Going to try to stop instance {{(pid=120572) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 02 09:12:50.840328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:50.848411 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a34097ef-8675-4717-a796-a0e4e55d9e0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1680 microversion: 2.1 time: 0.192886 Sep 02 09:12:50.849376 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 327/636] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:50 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:50.867211 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d93c8d60-12db-4a4f-bbaa-2778e8636cc6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/action" status: 202 len: 0 microversion: 2.1 time: 0.101064 Sep 02 09:12:50.867936 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 310/637] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:12:50 2022] POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 09:12:50.876251 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:50.876868 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:50.882709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.883232 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.883672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:50.884410 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:50.884867 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:50.885290 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:51.039783 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:51.048021 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5aedf3f0-967d-423f-ad7e-a4f4c3439b11 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.176049 Sep 02 09:12:51.048587 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 328/638] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:50 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:51.554187 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-76986643-688a-4384-b363-589de5d40083 req-2d092c1f-fd58-4a64-851d-a5f37d173b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6b1337-6402-4108-aef8-2ad90760a201", "name": "network-vif-plugged", "status": "completed", "tag": "d40e6588-7e5a-43ac-bea3-7b456bc3d155"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:51.565511 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-76986643-688a-4384-b363-589de5d40083 req-2d092c1f-fd58-4a64-851d-a5f37d173b60 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:51.565985 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-76986643-688a-4384-b363-589de5d40083 req-2d092c1f-fd58-4a64-851d-a5f37d173b60 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:51.566407 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-76986643-688a-4384-b363-589de5d40083 req-2d092c1f-fd58-4a64-851d-a5f37d173b60 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:51.586676 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-76986643-688a-4384-b363-589de5d40083 req-2d092c1f-fd58-4a64-851d-a5f37d173b60 service nova] Creating event network-vif-plugged:d40e6588-7e5a-43ac-bea3-7b456bc3d155 for instance 5d6b1337-6402-4108-aef8-2ad90760a201 on hv-cinder-85535 Sep 02 09:12:51.591424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-76986643-688a-4384-b363-589de5d40083 req-2d092c1f-fd58-4a64-851d-a5f37d173b60 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043385 Sep 02 09:12:51.592015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 311/639] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:12:51.626358 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:51.626977 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:51.633352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:51.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:51.634277 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:51.634971 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:51.635454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:51.635870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:51.766124 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:51.774550 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:51.776013 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:51.777173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2947d97b-6226-4910-9819-6579d88346ba tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.154701 Sep 02 09:12:51.777732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 329/640] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:51 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:51.870628 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:51.871344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:51.877356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:51.877837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:51.878267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:51.878952 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:51.879435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:51.879855 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:52.013523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:52.021582 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6f73c5e0-e2c7-406a-84c6-3044a79cd897 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1680 microversion: 2.1 time: 0.155129 Sep 02 09:12:52.022143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 312/641] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:51 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:52.068592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:52.069195 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:52.075077 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:52.075567 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:52.076002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:52.076681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:52.077386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:52.077806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:52.205444 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:52.213594 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dcb9a86a-373b-450a-8685-e51844edab81 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1722 microversion: 2.1 time: 0.148734 Sep 02 09:12:52.214163 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 330/642] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:52 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:52.800628 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:52.801290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:52.807890 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:52.808383 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:52.808815 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:52.809503 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:52.809953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:52.810372 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:52.939243 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:52.947814 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:52.949251 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:52.950398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aa857200-f4e3-4912-b3dc-4f1135f3844a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.154281 Sep 02 09:12:52.950951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 313/643] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:52 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:53.041917 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:53.042531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:53.050147 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:53.050643 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:53.051095 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:53.051809 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:53.052266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:53.052690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:53.181039 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:53.189520 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3729d887-7157-478a-9c4e-8d172ad5c8f2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1680 microversion: 2.1 time: 0.151403 Sep 02 09:12:53.190220 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 331/644] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:53 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:53.235876 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:53.236492 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:53.243163 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:53.243653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:53.244091 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:53.244784 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:53.245248 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:53.245674 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:53.535979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:53.543699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5e7455c6-3507-40c6-8bb5-64d21a2ba2ef tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1676 microversion: 2.1 time: 0.312370 Sep 02 09:12:53.544700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 314/645] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:53 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1676 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:53.973637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:53.974269 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:53.980476 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:53.980987 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:53.981483 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:53.982205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:53.982679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:53.983149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:54.209950 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:54.211682 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:54.219241 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:54.219987 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:54.220502 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:54.221313 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:54.221831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:54.222260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:54.238277 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:54.248841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:54.251229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:54.252676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-91b4fb82-8a73-4f70-abed-2aef255dca18 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.283203 Sep 02 09:12:54.253375 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 332/646] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:53 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:54.258240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-72988b53-1a52-41ea-911b-434b3e908ff3 req-038beb56-2c8c-40c9-9b77-9dfa82ecd242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d27c557-5d34-45da-93ea-f6c2a86a807e", "name": "network-vif-deleted", "tag": "9b0d7846-3d45-4ced-b88d-87787c99ba4a"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:54.270748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-72988b53-1a52-41ea-911b-434b3e908ff3 req-038beb56-2c8c-40c9-9b77-9dfa82ecd242 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:54.272267 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-72988b53-1a52-41ea-911b-434b3e908ff3 req-038beb56-2c8c-40c9-9b77-9dfa82ecd242 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:54.272954 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-72988b53-1a52-41ea-911b-434b3e908ff3 req-038beb56-2c8c-40c9-9b77-9dfa82ecd242 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:54.288340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-72988b53-1a52-41ea-911b-434b3e908ff3 req-038beb56-2c8c-40c9-9b77-9dfa82ecd242 service nova] Creating event network-vif-deleted:9b0d7846-3d45-4ced-b88d-87787c99ba4a for instance 6d27c557-5d34-45da-93ea-f6c2a86a807e on hv-cinder-85535 Sep 02 09:12:54.294722 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-72988b53-1a52-41ea-911b-434b3e908ff3 req-038beb56-2c8c-40c9-9b77-9dfa82ecd242 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039968 Sep 02 09:12:54.296159 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 333/647] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:12:54.309108 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:54.318302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0a54d54a-e7bc-47f7-9ed4-cb33116d6548 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1613 microversion: 2.1 time: 0.112114 Sep 02 09:12:54.319720 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 315/648] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:54 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:12:54.565046 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:54.565745 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:54.572977 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:54.573461 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:54.573897 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:54.574585 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:54.575035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:54.575481 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:54.710708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:54.721400 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8e22057f-eeb3-46c9-93ff-268f7dd33626 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1676 microversion: 2.1 time: 0.159570 Sep 02 09:12:54.722761 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 334/649] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:54 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:55.279763 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:55.280488 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:55.287609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:55.288099 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:55.288567 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:55.289286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:55.289788 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:55.290235 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:55.344170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:55.349879 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:55.356816 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:55.357423 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:55.357751 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:55.358448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:55.358901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:55.359980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:55.390913 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:55.391302 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:55.391730 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:55.392174 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lazy-loading 'fault' on Instance uuid 6d27c557-5d34-45da-93ea-f6c2a86a807e {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:12:55.449288 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:55.456959 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e9ede703-51f8-4aef-bc5d-85a9e7ba0861 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 200 len: 1330 microversion: 2.1 time: 0.121451 Sep 02 09:12:55.457841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 335/650] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:55 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 1330 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:55.472577 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:55.481755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:55.483215 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:55.484978 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fa5b0cc1-f477-4dac-b98f-2247b705d79b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1807 microversion: 2.20 time: 0.208697 Sep 02 09:12:55.485526 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 316/651] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:55 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:12:55.743630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:55.744250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:55.750637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:55.751391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:55.752219 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:55.753067 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:55.753563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:55.753993 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:55.868840 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-321bc285-ae82-4791-9ea1-d7e4760b99b5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99605215-941c-4177-bbbb-763763d4607f"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:55.871687 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-321bc285-ae82-4791-9ea1-d7e4760b99b5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:55.873998 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:55.880628 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-321bc285-ae82-4791-9ea1-d7e4760b99b5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:55.881381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-321bc285-ae82-4791-9ea1-d7e4760b99b5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:55.881814 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-321bc285-ae82-4791-9ea1-d7e4760b99b5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:55.882731 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-321bc285-ae82-4791-9ea1-d7e4760b99b5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:55.883372 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-321bc285-ae82-4791-9ea1-d7e4760b99b5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:55.883967 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-321bc285-ae82-4791-9ea1-d7e4760b99b5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:55.899354 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:55.907399 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4497508f-eb78-4021-959c-fd29968d20ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1676 microversion: 2.1 time: 0.167806 Sep 02 09:12:55.907978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 336/652] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:55 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:56.149761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-321bc285-ae82-4791-9ea1-d7e4760b99b5 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284950 Sep 02 09:12:56.150354 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 317/653] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:12:55 2022] POST /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:12:56.480796 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:56.481407 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:56.487790 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:56.488281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:56.488716 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:56.489416 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:56.489863 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:56.490287 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:56.503391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e HTTP/1.1 Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:12:56.505016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:12:56.506509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '6d27c557-5d34-45da-93ea-f6c2a86a807e'} Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:12:56.508133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:12:56.509599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:12:56.510881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:12:56.510881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7999c130-0b43-4ab4-8e8e-8b2a07816480 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 404 len: 111 microversion: 2.1 time: 0.029436 Sep 02 09:12:56.510881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 337/654] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:56 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:12:56.511189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:56.511189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:56.514755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9b12f7df-f219-49e6-ab39-924bd3a2d263 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '.version_select at 0x7f54bc5f4160>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:56.517109 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:56.517588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:56.518021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:56.518709 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:56.519317 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:56.519745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:56.523779 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:12:56.534566 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9b12f7df-f219-49e6-ab39-924bd3a2d263 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-737700974" status: 202 len: 0 microversion: 2.1 time: 0.023279 Sep 02 09:12:56.535168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 338/655] 10.222.0.36 () {58 vars in 1218 bytes} [Fri Sep 2 09:12:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-737700974 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:12:56.709222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:56.717655 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:56.719678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:56.720872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-de090273-72e9-4d8c-b612-1ffb669a9063 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1794 microversion: 2.20 time: 0.216416 Sep 02 09:12:56.721463 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 318/656] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:12:56 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1794 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:12:56.929807 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:56.930425 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:56.937048 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:56.938038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:56.938473 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:56.939195 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:56.939652 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:56.940075 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:57.071414 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:57.080007 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-088b47be-fa23-4343-92ab-80eda965f82b tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1676 microversion: 2.1 time: 0.154150 Sep 02 09:12:57.080575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 339/657] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:56 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:12:57.230623 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9e385ee9-66ae-492a-8ccb-e91b3e94d3d7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: .version_select at 0x7f54bc3704c0>, body: {"keypair": {"name": "tempest-keypair-663711302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+51I9fb8QfMYzM5wCCDCccSa+xp3twnesG9N2P+aGx2IvfTcCqLkpdWxFezX5W/p/KOEGDZCalcV11aJMcbjkPin9d2vk5O+uUTnANED+HfkkS7+kwV4sCSXJkPSJ/zQ=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:57.246622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-9e385ee9-66ae-492a-8ccb-e91b3e94d3d7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:12:57.250924 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-9e385ee9-66ae-492a-8ccb-e91b3e94d3d7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for user e8b5ce2249a84c01ab57c03b656b2949 and project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:12:57.272591 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9e385ee9-66ae-492a-8ccb-e91b3e94d3d7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045827 Sep 02 09:12:57.273187 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 319/658] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:12:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:12:58.101137 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:58.101759 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:58.108062 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:58.108554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:58.109020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:58.110257 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:58.110712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:58.111168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:58.341075 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:58.351669 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7757927f-d855-4f29-85f9-fb981ab0c656 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1676 microversion: 2.1 time: 0.254411 Sep 02 09:12:58.352251 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 340/659] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:58 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1676 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:58.596601 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1318295988", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "426b5f66-dceb-4940-aa95-179f2d5137c7"}], "security_groups": [{"name": "tempest-securitygroup--2060668830"}], "key_name": "tempest-keypair-663711302", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:12:58.702494 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] validate_networks() for [('426b5f66-dceb-4940-aa95-179f2d5137c7', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:12:59.058181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:12:59.058631 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:12:59.059128 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:12:59.059544 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:12:59.059953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:12:59.069068 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:59.069551 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:59.069986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:59.070705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:59.071185 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:59.071606 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:59.088306 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:12:59.092189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for user e8b5ce2249a84c01ab57c03b656b2949 and project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:12:59.102835 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:12:59.105172 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:12:59.153845 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2574f35a-549f-4f7d-8c34-7561f19aacca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.561676 Sep 02 09:12:59.154492 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 320/660] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:12:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:12:59.165364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4b48f9f1-3ed4-4af3-81a3-cda2ca1c1806 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:59.165983 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4b48f9f1-3ed4-4af3-81a3-cda2ca1c1806 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:59.219689 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4b48f9f1-3ed4-4af3-81a3-cda2ca1c1806 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:59.226412 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4b48f9f1-3ed4-4af3-81a3-cda2ca1c1806 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1241 microversion: 2.1 time: 0.064920 Sep 02 09:12:59.227043 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 341/661] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:59 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:12:59.374627 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:12:59.375835 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:12:59.382787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:59.383449 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:59.384120 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:59.384933 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:12:59.385460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:12:59.385961 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:12:59.519229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:12:59.527057 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3052ea5a-23da-40e1-8b59-c5502a692e58 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1676 microversion: 2.1 time: 0.157413 Sep 02 09:12:59.527993 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 321/662] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:12:59 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:00.249307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:00.249847 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:00.256023 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:00.256500 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:00.256930 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:00.257618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:00.258067 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:00.258491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:00.321740 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:00.330024 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6041c53d-b122-427b-bf37-4e2fc1cdead2 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1293 microversion: 2.1 time: 0.085217 Sep 02 09:13:00.330586 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 342/663] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:00 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:00.549660 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:00.550368 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:00.558161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:00.558758 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:00.559307 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:00.560090 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:00.560613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:00.561118 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:00.888345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:00.896712 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-92a13c7b-203a-42b8-ba3c-f2f0dcc9787e tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1676 microversion: 2.1 time: 0.351118 Sep 02 09:13:00.897305 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 322/664] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:00 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1676 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:01.349718 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:01.350338 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:01.356631 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:01.357318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:01.358534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:01.359313 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:01.359774 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:01.360199 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:01.560565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:01.570543 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ed96b70-4f91-4dcd-83e3-45e58027b778 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1367 microversion: 2.1 time: 0.224506 Sep 02 09:13:01.571153 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 343/665] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:01 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:01.918204 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:01.918950 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:01.925857 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:01.926378 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:01.926821 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:01.927558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:01.928042 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:01.928476 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:02.124837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:02.132409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8c3d682f-ef77-4fb0-b929-781b8fb1e83f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1676 microversion: 2.1 time: 0.218159 Sep 02 09:13:02.132975 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 323/666] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:01 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:02.197190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-02bc094e-e3da-4f6a-997f-d878aeb56532 req-9db56dfd-e0d6-423a-a20c-a0cf06358e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84250eef-a56f-4e60-bbdc-95143e398d49", "tag": "4b639641-fe71-4e82-bc3f-342eee50c5c3"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:02.206995 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-02bc094e-e3da-4f6a-997f-d878aeb56532 req-9db56dfd-e0d6-423a-a20c-a0cf06358e8e service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:02.207565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-02bc094e-e3da-4f6a-997f-d878aeb56532 req-9db56dfd-e0d6-423a-a20c-a0cf06358e8e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:02.207994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-02bc094e-e3da-4f6a-997f-d878aeb56532 req-9db56dfd-e0d6-423a-a20c-a0cf06358e8e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:02.211800 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:02.220289 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-02bc094e-e3da-4f6a-997f-d878aeb56532 req-9db56dfd-e0d6-423a-a20c-a0cf06358e8e service nova] Creating event network-changed:4b639641-fe71-4e82-bc3f-342eee50c5c3 for instance 84250eef-a56f-4e60-bbdc-95143e398d49 on hv-cinder-85535 Sep 02 09:13:02.225242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-02bc094e-e3da-4f6a-997f-d878aeb56532 req-9db56dfd-e0d6-423a-a20c-a0cf06358e8e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031727 Sep 02 09:13:02.225840 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 344/667] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:02.591809 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:02.592490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:02.599045 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:02.599572 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:02.600010 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:02.600701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:02.601157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:02.601584 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:02.736303 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:02.744414 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-95722ca9-3c98-415e-bc5d-89c077c12321 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1367 microversion: 2.1 time: 0.155795 Sep 02 09:13:02.745151 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 324/668] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:02 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:03.154353 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:03.155109 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:03.161781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:03.162264 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:03.162699 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:03.163421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:03.163878 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:03.164301 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:03.337005 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:03.345150 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0ed4bcea-e0fc-4ad4-b7c0-7b963e1fe73c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1676 microversion: 2.1 time: 0.195421 Sep 02 09:13:03.345813 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 345/669] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:03 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:03.698288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:03.700640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:03.707242 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:03.707724 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:03.708156 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:03.708834 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:03.709299 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:03.709699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:03.731607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lazy-loading 'flavor' on Instance uuid 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:13:03.764589 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:03.765133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:03.770895 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:03.771405 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:03.771843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:03.772526 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:03.772978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:03.773398 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:03.888595 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9f495656-833c-4012-8e80-518698daf859 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/action" status: 200 len: 32 microversion: 2.1 time: 0.194189 Sep 02 09:13:03.889209 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 325/670] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:13:03 2022] POST /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:13:03.898776 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:03.899508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:03.903268 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:03.905812 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:03.907287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:03.907287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:03.907982 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:03.908460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:03.908886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:03.911260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0d6e00cc-2732-4e1c-9f7b-d1f9ff73fb39 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1367 microversion: 2.1 time: 0.150458 Sep 02 09:13:03.911824 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 346/671] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:03 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:04.034857 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:04.043334 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-34d44e66-f6d9-49d7-ad0e-86560654318b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.148583 Sep 02 09:13:04.043905 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 326/672] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:03 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:04.365699 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:04.366309 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:04.372673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:04.373137 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:04.373565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:04.374242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:04.374692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:04.375136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:04.518540 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:04.526275 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-44bcb039-b7b0-4916-8ead-f3b0ffb985dd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1653 microversion: 2.1 time: 0.164425 Sep 02 09:13:04.526854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 347/673] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:04 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1653 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:04.547381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f2105ddd-ee6d-401f-ab20-d69c9573d231 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:04.553343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2105ddd-ee6d-401f-ab20-d69c9573d231 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:04.553833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2105ddd-ee6d-401f-ab20-d69c9573d231 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:04.554276 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2105ddd-ee6d-401f-ab20-d69c9573d231 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:04.576205 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f2105ddd-ee6d-401f-ab20-d69c9573d231 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Going to try to start instance {{(pid=120572) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 02 09:13:04.618991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f2105ddd-ee6d-401f-ab20-d69c9573d231 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/action" status: 202 len: 0 microversion: 2.1 time: 0.075547 Sep 02 09:13:04.623287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 327/674] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:13:04 2022] POST /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:13:04.629355 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:04.630297 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:04.636879 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:04.637757 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:04.639284 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:04.640280 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:04.641240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:04.641662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:04.895745 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:04.903247 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a22f1584-1aab-43d1-a26f-6cda07813954 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1662 microversion: 2.1 time: 0.278872 Sep 02 09:13:04.903821 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 348/675] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:04 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1662 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:04.933386 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:04.934276 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:04.942340 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:04.942850 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:04.943379 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:04.944082 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:04.944699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:04.945122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:05.065381 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:05.066025 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:05.072464 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:05.073002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:05.073438 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:05.074131 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:05.074583 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:05.075004 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:05.301891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:05.309427 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e121e060-0255-4986-81c5-c9120f0f59a8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1367 microversion: 2.1 time: 0.381075 Sep 02 09:13:05.309996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 328/676] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:04 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:05.410350 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:05.419152 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-248ac887-bf1d-405c-862d-9981d979243d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.358089 Sep 02 09:13:05.432944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 349/677] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:05 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:05.923336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:05.923941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:05.929990 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:05.930469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:05.930902 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:05.931613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:05.932065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:05.932483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:06.059167 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:06.066747 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-80b28754-9173-4e5a-b41d-91508f96f8b5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1662 microversion: 2.1 time: 0.147276 Sep 02 09:13:06.067333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 329/678] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:05 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1662 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:06.331280 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:06.331821 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:06.337700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:06.338186 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:06.338624 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:06.339338 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:06.339797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:06.340222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:06.441048 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:06.441654 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:06.447466 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:06.447948 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:06.448383 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:06.449064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:06.449512 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:06.449926 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:06.467500 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:06.475755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5ebb1e8c-6cb7-4063-a813-f570134ec7bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1367 microversion: 2.1 time: 0.149238 Sep 02 09:13:06.476422 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 350/679] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:06 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:06.576977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:06.585375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3b0bbc02-ca40-4feb-af20-d7a877fdcf6a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.148586 Sep 02 09:13:06.585887 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 330/680] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:06 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:07.088937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:07.088937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:07.095127 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:07.095611 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:07.096050 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:07.096738 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:07.097192 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:07.097618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:07.225656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:07.233138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d95ebb3e-21ea-4cc6-9d8e-a59fa1eca04f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1666 microversion: 2.1 time: 0.148956 Sep 02 09:13:07.233699 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 351/681] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:07 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1666 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:07.496531 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:07.497379 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:07.504032 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:07.504514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:07.504950 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:07.505642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:07.506097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:07.506525 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:07.605743 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:07.606387 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:07.612727 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:07.613219 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:07.613656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:07.614346 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:07.614805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:07.615254 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:07.633649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:07.641591 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e7496b1d-c8fb-4fcd-94ab-1460e5ae3bbf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1367 microversion: 2.1 time: 0.148996 Sep 02 09:13:07.644955 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 331/682] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:07 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:07.748665 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:07.757477 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b08f4f67-b084-400a-9afb-ec94cabd55b2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.155606 Sep 02 09:13:07.758050 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 352/683] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:07 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:08.662202 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:08.662872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:08.669164 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:08.669608 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:08.670061 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:08.670749 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:08.671229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:08.672271 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:08.779271 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:08.779949 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:08.786729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:08.787248 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:08.787686 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:08.788380 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:08.788841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:08.789264 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:08.798233 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:08.805715 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7dfcffa6-1a24-4dc3-8725-6e52aa8c2cde tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1367 microversion: 2.1 time: 0.147372 Sep 02 09:13:08.806282 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 332/684] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:08 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:08.918728 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:08.926729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-42415b11-6adc-4523-abf7-c7b0bd15ff86 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.151374 Sep 02 09:13:08.927318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 353/685] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:08 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:09.540132 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-3cda668a-12d5-48bf-ab23-e8a586e9a8c0 req-e3761dd9-600e-44fe-8e61-5be686097978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84250eef-a56f-4e60-bbdc-95143e398d49", "name": "network-vif-plugged", "status": "completed", "tag": "4b639641-fe71-4e82-bc3f-342eee50c5c3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:09.545088 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.545743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=10 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.552667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3cda668a-12d5-48bf-ab23-e8a586e9a8c0 req-e3761dd9-600e-44fe-8e61-5be686097978 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:09.553132 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3cda668a-12d5-48bf-ab23-e8a586e9a8c0 req-e3761dd9-600e-44fe-8e61-5be686097978 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:09.553564 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3cda668a-12d5-48bf-ab23-e8a586e9a8c0 req-e3761dd9-600e-44fe-8e61-5be686097978 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:09.565031 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-3cda668a-12d5-48bf-ab23-e8a586e9a8c0 req-e3761dd9-600e-44fe-8e61-5be686097978 service nova] Creating event network-vif-plugged:4b639641-fe71-4e82-bc3f-342eee50c5c3 for instance 84250eef-a56f-4e60-bbdc-95143e398d49 on hv-cinder-85535 Sep 02 09:13:09.569729 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-3cda668a-12d5-48bf-ab23-e8a586e9a8c0 req-e3761dd9-600e-44fe-8e61-5be686097978 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033285 Sep 02 09:13:09.570316 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 333/686] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:09.826373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:09.827028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:09.829285 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.835337 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:09.835866 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:09.836343 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:09.837112 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:09.837618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:09.838106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:09.948451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:09.949252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:09.955663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:09.956139 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:09.956578 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:09.957269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:09.957728 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:09.958157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:09.962227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:09.965115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:09.973124 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-868cb7db-82c4-4207-a36c-f94825e0c310 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1367 microversion: 2.1 time: 0.150831 Sep 02 09:13:09.973703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 354/687] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:09 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:10.342856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:10.351614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-efef45a1-0104-406b-afdf-39ec791641aa tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.407864 Sep 02 09:13:10.352370 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 334/688] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:09 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:10.994838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:10.995412 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:11.002202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:11.002681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:11.003139 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:11.003827 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:11.004279 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:11.004698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:11.131034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:11.138497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7ade6eb3-69ff-4fa8-8bf5-b5cac5d17b0a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1367 microversion: 2.1 time: 0.147647 Sep 02 09:13:11.139060 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 355/689] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:10 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:11.371462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:11.372071 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:11.379007 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:11.379526 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:11.379958 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:11.380641 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:11.381094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:11.381513 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:11.513740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:11.522485 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a61dcced-4920-4824-85c1-deebc6dec469 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.154803 Sep 02 09:13:11.523062 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 335/690] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:11 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:12.159325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:12.159937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:12.166301 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:12.166783 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:12.167248 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:12.167936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:12.168390 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:12.168813 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:12.291660 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:12.299180 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82799bd2-f7c8-4ae5-9088-2053b3e99582 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1557 microversion: 2.1 time: 0.144305 Sep 02 09:13:12.299761 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 356/691] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:12 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1557 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:12.319215 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-515cee82-8570-4c28-b923-be2afb1ab1ca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:12.319711 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-515cee82-8570-4c28-b923-be2afb1ab1ca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:12.325556 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-515cee82-8570-4c28-b923-be2afb1ab1ca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:12.326068 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-515cee82-8570-4c28-b923-be2afb1ab1ca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:12.326505 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-515cee82-8570-4c28-b923-be2afb1ab1ca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:12.327251 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-515cee82-8570-4c28-b923-be2afb1ab1ca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:12.328600 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-515cee82-8570-4c28-b923-be2afb1ab1ca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:12.329035 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-515cee82-8570-4c28-b923-be2afb1ab1ca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:12.404368 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-515cee82-8570-4c28-b923-be2afb1ab1ca tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088965 Sep 02 09:13:12.404976 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 336/692] 10.222.0.36 () {58 vars in 1275 bytes} [Fri Sep 2 09:13:12 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:12.544044 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:12.544842 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:12.551293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:12.551843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:12.552345 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:12.553126 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:12.553648 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:12.554135 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:12.787944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:12.796026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-06098962-1b56-4e04-b84a-53f4bdf4ace6 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.255795 Sep 02 09:13:12.796578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 357/693] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:12 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:13.397173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-8d44e50b-d918-489c-b56b-13cf64fc50d3 req-d0894dff-badb-4a6d-b615-b20e3365a9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84250eef-a56f-4e60-bbdc-95143e398d49", "tag": "4b639641-fe71-4e82-bc3f-342eee50c5c3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:13.407098 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8d44e50b-d918-489c-b56b-13cf64fc50d3 req-d0894dff-badb-4a6d-b615-b20e3365a9ca service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:13.407670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8d44e50b-d918-489c-b56b-13cf64fc50d3 req-d0894dff-badb-4a6d-b615-b20e3365a9ca service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:13.408149 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8d44e50b-d918-489c-b56b-13cf64fc50d3 req-d0894dff-badb-4a6d-b615-b20e3365a9ca service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:13.419032 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-8d44e50b-d918-489c-b56b-13cf64fc50d3 req-d0894dff-badb-4a6d-b615-b20e3365a9ca service nova] Creating event network-changed:4b639641-fe71-4e82-bc3f-342eee50c5c3 for instance 84250eef-a56f-4e60-bbdc-95143e398d49 on hv-cinder-85535 Sep 02 09:13:13.423966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-8d44e50b-d918-489c-b56b-13cf64fc50d3 req-d0894dff-badb-4a6d-b615-b20e3365a9ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030962 Sep 02 09:13:13.424610 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 337/694] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:13.817853 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:13.818589 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:13.826475 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:13.826475 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:13.826922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:13.827928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:13.828586 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:13.828977 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:14.043046 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:14.052441 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-826b1ee3-3800-425f-b752-2344254d8d90 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.238734 Sep 02 09:13:14.053017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 358/695] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:13 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:15.074100 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:15.074721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:15.081041 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:15.081523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:15.081959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:15.082644 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:15.083119 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:15.083544 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:15.213456 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:15.222031 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7d791e3b-f942-4a9c-8d0c-9001909c48b4 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.152839 Sep 02 09:13:15.222593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 338/696] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:15 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:16.243192 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:16.243806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:16.250266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:16.250779 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:16.251249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:16.251933 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:16.252386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:16.252806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:16.376717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:16.384662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3ff614b9-3bec-4e3a-a1b1-a5eb0323e9db tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.145352 Sep 02 09:13:16.385224 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 359/697] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:16 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:17.405341 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:17.405949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:17.412898 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:17.413381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:17.413817 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:17.414502 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:17.414956 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:17.415411 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:17.542971 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:17.551783 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ba99b26f-ee2b-4b4e-82e0-ce2d3b050ff2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.150259 Sep 02 09:13:17.552352 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 339/698] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:17 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:18.572649 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:18.573259 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:18.579869 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:18.580368 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:18.580805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:18.581483 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:18.581932 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:18.582351 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:18.716479 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:18.725251 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-89655980-0bb5-441f-ae04-b9026acde8d8 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.156449 Sep 02 09:13:18.725859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 360/699] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:18 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:19.747524 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:19.748070 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:19.755144 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:19.755676 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:19.756217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:19.756887 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:19.757353 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:19.757755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:19.882880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:19.890818 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9349801e-da71-4e31-9531-f2df4a208841 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.147206 Sep 02 09:13:19.892038 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 340/700] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:19 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:20.912156 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:20.912769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:20.915112 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:20.920755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:20.921234 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:20.921874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:20.923257 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:20.923767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:20.924237 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:20.942971 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:21.053173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:21.061361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bfe79d7b-dd91-432c-bcc9-32f62b6a8aee tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.153121 Sep 02 09:13:21.061960 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 361/701] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:20 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:22.082487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:22.083148 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:22.089647 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:22.090142 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:22.090585 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:22.091318 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:22.091778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:22.092210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:22.238190 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:22.246262 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c398cad6-a81f-45c1-b195-a703b8c6e98a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.167595 Sep 02 09:13:22.246762 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 341/702] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:22 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:23.266517 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:23.267172 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:23.273603 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:23.274082 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:23.274510 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:23.275217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:23.275668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:23.276085 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:23.404054 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:23.412157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f7709aa2-fc3c-4713-aa42-7ab53d0500fb tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1737 microversion: 2.1 time: 0.149435 Sep 02 09:13:23.412717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 362/703] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:23 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:24.433025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:24.433671 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:24.440005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:24.440486 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:24.440923 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:24.441607 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:24.442059 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:24.442483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:24.572070 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:24.580971 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3718d151-8a62-4437-97aa-550d154463c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1717 microversion: 2.1 time: 0.151814 Sep 02 09:13:24.581540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 342/704] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:24 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:24.691080 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:24.691616 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:24.698242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:24.698744 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:24.699246 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:24.699964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:24.700432 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:24.700891 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:24.780719 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] HTTP exception thrown: Cannot 'detach_volume' instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 while it is in vm_state rescued Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Request method failure captured: Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments/99605215-941c-4177-bbbb-763763d4607f HTTP/1.1 Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgc-uyj7G6dkesaoNotQXdG__Azb6l7pI9LJKFcZj1PxIrGFALWEzddAGu90ss9M-9iP9TCYmteOUjCJf4oYRyOi8Luhyj05cqciZdmQ8jCPqUJXj0HSPqyyQS2_cu0OrG6pklymGb8Aj6MPaar9pB3jV51Db9oha0q2YpmIr2Kv1M Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:13:24.782673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6fde620889f34b04bb7c9fcd5ad0a368", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: bf58157cbc8e49c5bd913c68ff859bfb Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:13:24.784388 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Cannot 'detach_volume' instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 while it is in vm_state rescued Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'server_id': '57a43d50-d1ca-449a-82ef-3df6b6fa88b8', 'id': '99605215-941c-4177-bbbb-763763d4607f'} Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:13:24.785507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 while it is in vm_state rescued Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 while it is in vm_state rescued Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:24.787056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Returning 409 to user: Cannot 'detach_volume' instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 while it is in vm_state rescued {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:13:24.788435 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bf53f1d5-888a-4117-a1d3-bf65a60d8155 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "DELETE /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments/99605215-941c-4177-bbbb-763763d4607f" status: 409 len: 152 microversion: 2.1 time: 0.097673 Sep 02 09:13:24.788435 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 363/705] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:13:24 2022] DELETE /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments/99605215-941c-4177-bbbb-763763d4607f => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 09:13:24.792961 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-52eb2569-c85c-456b-9352-6ade7f5c8c5c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:24.793515 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-52eb2569-c85c-456b-9352-6ade7f5c8c5c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:24.799232 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52eb2569-c85c-456b-9352-6ade7f5c8c5c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:24.799709 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52eb2569-c85c-456b-9352-6ade7f5c8c5c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:24.800136 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52eb2569-c85c-456b-9352-6ade7f5c8c5c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:24.800807 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52eb2569-c85c-456b-9352-6ade7f5c8c5c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:24.801251 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52eb2569-c85c-456b-9352-6ade7f5c8c5c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:24.801668 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52eb2569-c85c-456b-9352-6ade7f5c8c5c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:24.864393 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-52eb2569-c85c-456b-9352-6ade7f5c8c5c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "POST /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/action" status: 202 len: 0 microversion: 2.1 time: 0.075002 Sep 02 09:13:24.865016 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 343/706] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:13:24 2022] POST /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:13:24.873064 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:24.873751 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:24.881143 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:24.881636 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:24.882069 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:24.882767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:24.883259 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:24.883690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:25.093940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:25.102009 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fc8c4d29-8842-463c-88a7-99dd26238c58 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1725 microversion: 2.1 time: 0.232795 Sep 02 09:13:25.102662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 364/707] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:24 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:26.123488 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:26.124182 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:26.126153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:26.132194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:26.132668 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:26.133101 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:26.133782 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:26.134234 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:26.134656 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:26.263397 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:26.271381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-693b9018-638a-4e71-8d59-8b2e15f2126c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1725 microversion: 2.1 time: 0.152614 Sep 02 09:13:26.271941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 344/708] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:26 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:27.292839 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:27.293569 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:27.302086 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:27.302700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:27.303239 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:27.304106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:27.304557 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:27.305032 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:27.435487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:27.447408 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9cf4d32d-c6d2-4fe9-8881-ee1fe78e480c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1725 microversion: 2.1 time: 0.158636 Sep 02 09:13:27.447974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 365/709] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:27 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:28.469010 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:28.469618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:28.476473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:28.476960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:28.477395 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:28.478116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:28.478573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:28.478998 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:28.602306 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:28.610335 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-23021edb-ca5e-4fb5-a46c-2d52143d808b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1731 microversion: 2.1 time: 0.145154 Sep 02 09:13:28.610901 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 345/710] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:28 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1731 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:28.630944 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-67a38750-3f12-420c-97ab-00a2a1098607 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:28.631459 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-67a38750-3f12-420c-97ab-00a2a1098607 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:28.637741 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67a38750-3f12-420c-97ab-00a2a1098607 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:28.638225 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67a38750-3f12-420c-97ab-00a2a1098607 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:28.638662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67a38750-3f12-420c-97ab-00a2a1098607 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:28.639383 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67a38750-3f12-420c-97ab-00a2a1098607 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:28.639841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67a38750-3f12-420c-97ab-00a2a1098607 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:28.640266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67a38750-3f12-420c-97ab-00a2a1098607 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:28.718781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-67a38750-3f12-420c-97ab-00a2a1098607 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091643 Sep 02 09:13:28.719432 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 366/711] 10.222.0.36 () {58 vars in 1275 bytes} [Fri Sep 2 09:13:28 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:29.826017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-bb4a98e7-8a5e-4e2b-b944-439402515b32 req-d075a3d8-00e3-4f5d-9170-f9dda2ea0694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a43d50-d1ca-449a-82ef-3df6b6fa88b8", "tag": "91ef318d-54a2-4c8e-ab4c-a5d4963d60aa"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:29.836737 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bb4a98e7-8a5e-4e2b-b944-439402515b32 req-d075a3d8-00e3-4f5d-9170-f9dda2ea0694 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:29.837300 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bb4a98e7-8a5e-4e2b-b944-439402515b32 req-d075a3d8-00e3-4f5d-9170-f9dda2ea0694 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:29.837792 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bb4a98e7-8a5e-4e2b-b944-439402515b32 req-d075a3d8-00e3-4f5d-9170-f9dda2ea0694 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:29.849604 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-bb4a98e7-8a5e-4e2b-b944-439402515b32 req-d075a3d8-00e3-4f5d-9170-f9dda2ea0694 service nova] Creating event network-changed:91ef318d-54a2-4c8e-ab4c-a5d4963d60aa for instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 on hv-cinder-85535 Sep 02 09:13:29.855116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-bb4a98e7-8a5e-4e2b-b944-439402515b32 req-d075a3d8-00e3-4f5d-9170-f9dda2ea0694 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032667 Sep 02 09:13:29.855478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 346/712] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:31.870482 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-a428c749-905a-4385-befe-ebf813a7737b req-aa5b6c85-77a6-41d3-8cdc-a62f3b459525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a43d50-d1ca-449a-82ef-3df6b6fa88b8", "tag": "91ef318d-54a2-4c8e-ab4c-a5d4963d60aa"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:31.879794 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a428c749-905a-4385-befe-ebf813a7737b req-aa5b6c85-77a6-41d3-8cdc-a62f3b459525 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:31.880265 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a428c749-905a-4385-befe-ebf813a7737b req-aa5b6c85-77a6-41d3-8cdc-a62f3b459525 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:31.880690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a428c749-905a-4385-befe-ebf813a7737b req-aa5b6c85-77a6-41d3-8cdc-a62f3b459525 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:31.893632 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-a428c749-905a-4385-befe-ebf813a7737b req-aa5b6c85-77a6-41d3-8cdc-a62f3b459525 service nova] Creating event network-changed:91ef318d-54a2-4c8e-ab4c-a5d4963d60aa for instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 on hv-cinder-85535 Sep 02 09:13:31.898458 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-a428c749-905a-4385-befe-ebf813a7737b req-aa5b6c85-77a6-41d3-8cdc-a62f3b459525 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032279 Sep 02 09:13:31.899022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 367/713] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:35.011138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f95cdcda-4d4e-4783-a658-1a26f1028688 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:35.011649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f95cdcda-4d4e-4783-a658-1a26f1028688 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:35.018312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95cdcda-4d4e-4783-a658-1a26f1028688 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:35.018788 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95cdcda-4d4e-4783-a658-1a26f1028688 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:35.019266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95cdcda-4d4e-4783-a658-1a26f1028688 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:35.019983 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95cdcda-4d4e-4783-a658-1a26f1028688 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:35.020435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95cdcda-4d4e-4783-a658-1a26f1028688 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:35.020856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95cdcda-4d4e-4783-a658-1a26f1028688 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:35.048358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f95cdcda-4d4e-4783-a658-1a26f1028688 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments/b6ceb41b-5361-43bc-aabb-4f9b38a6aa59" status: 200 len: 194 microversion: 2.20 time: 0.042257 Sep 02 09:13:35.048948 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 347/714] 10.222.0.36 () {60 vars in 1454 bytes} [Fri Sep 2 09:13:35 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments/b6ceb41b-5361-43bc-aabb-4f9b38a6aa59 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:13:35.114810 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:35.115439 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:35.121698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:35.122174 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:35.122604 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:35.123304 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:35.123753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:35.124168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:35.368233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lazy-loading 'services' on Instance uuid 5d6b1337-6402-4108-aef8-2ad90760a201 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:13:35.441942 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d576244-f7f5-4015-9248-7942721f7e9b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments/b6ceb41b-5361-43bc-aabb-4f9b38a6aa59" status: 202 len: 0 microversion: 2.20 time: 0.331195 Sep 02 09:13:35.442597 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 368/715] 10.222.0.36 () {60 vars in 1457 bytes} [Fri Sep 2 09:13:35 2022] DELETE /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments/b6ceb41b-5361-43bc-aabb-4f9b38a6aa59 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:35.450895 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0add347c-d7f8-41c0-97d8-ff669062361f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:35.453343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0add347c-d7f8-41c0-97d8-ff669062361f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:35.459365 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0add347c-d7f8-41c0-97d8-ff669062361f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:35.459854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0add347c-d7f8-41c0-97d8-ff669062361f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:35.460294 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0add347c-d7f8-41c0-97d8-ff669062361f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:35.460987 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0add347c-d7f8-41c0-97d8-ff669062361f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:35.461461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0add347c-d7f8-41c0-97d8-ff669062361f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:35.461880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0add347c-d7f8-41c0-97d8-ff669062361f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:35.491947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0add347c-d7f8-41c0-97d8-ff669062361f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044964 Sep 02 09:13:35.492514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 348/716] 10.222.0.36 () {60 vars in 1343 bytes} [Fri Sep 2 09:13:35 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:13:36.506851 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-39929cdf-6abc-45b0-a07f-6a2624407be1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:36.509224 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-39929cdf-6abc-45b0-a07f-6a2624407be1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:36.516665 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39929cdf-6abc-45b0-a07f-6a2624407be1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:36.517178 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39929cdf-6abc-45b0-a07f-6a2624407be1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:36.518165 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39929cdf-6abc-45b0-a07f-6a2624407be1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:36.518930 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39929cdf-6abc-45b0-a07f-6a2624407be1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:36.519527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39929cdf-6abc-45b0-a07f-6a2624407be1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:36.520536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39929cdf-6abc-45b0-a07f-6a2624407be1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:36.551681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-39929cdf-6abc-45b0-a07f-6a2624407be1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050520 Sep 02 09:13:36.552246 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 369/717] 10.222.0.36 () {60 vars in 1343 bytes} [Fri Sep 2 09:13:36 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:36.614215 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:36.614737 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:36.621046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:36.621522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:36.621954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:36.622634 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:36.623105 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:36.623533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:36.648866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:13:36.698135 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:36.725500 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b7765798-2053-4968-91a2-54330b055dcf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 204 len: 0 microversion: 2.20 time: 0.114655 Sep 02 09:13:36.726318 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 349/718] 10.222.0.36 () {60 vars in 1280 bytes} [Fri Sep 2 09:13:36 2022] DELETE /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 09:13:36.734374 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:36.734910 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:36.740663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:36.741140 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:36.741569 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:36.742243 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:36.742698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:36.743148 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:36.869206 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:36.877514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:36.878933 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:36.880108 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7ab16f18-50ba-44e6-b299-18fb25696a57 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.149633 Sep 02 09:13:36.880659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 370/719] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:36 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:37.903699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:37.904394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:37.911286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:37.911766 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:37.912192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:37.912867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:37.913315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:37.913732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:38.135236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:38.143906 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:38.145348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:38.146510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-333bfc92-4fba-46e6-9b80-e82ae4d97a35 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.247134 Sep 02 09:13:38.147062 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 350/720] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:37 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:39.169368 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:39.170076 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:39.177867 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:39.178415 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:39.178922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:39.179669 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:39.180116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:39.180534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:39.413695 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:39.421734 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:39.423229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:39.424891 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5f833996-35ea-456c-ab53-91f93c18020a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 200 len: 1722 microversion: 2.20 time: 0.259766 Sep 02 09:13:39.425661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 371/721] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:39 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:39.606205 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-e2608140-0418-4a7c-8077-14122d810f1a req-908e6247-77c9-4eaf-be13-4f4a7c4e86c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6b1337-6402-4108-aef8-2ad90760a201", "name": "network-vif-deleted", "tag": "d40e6588-7e5a-43ac-bea3-7b456bc3d155"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:39.618207 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e2608140-0418-4a7c-8077-14122d810f1a req-908e6247-77c9-4eaf-be13-4f4a7c4e86c0 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:39.618954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e2608140-0418-4a7c-8077-14122d810f1a req-908e6247-77c9-4eaf-be13-4f4a7c4e86c0 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:39.619495 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e2608140-0418-4a7c-8077-14122d810f1a req-908e6247-77c9-4eaf-be13-4f4a7c4e86c0 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:39.631141 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-e2608140-0418-4a7c-8077-14122d810f1a req-908e6247-77c9-4eaf-be13-4f4a7c4e86c0 service nova] Creating event network-vif-deleted:d40e6588-7e5a-43ac-bea3-7b456bc3d155 for instance 5d6b1337-6402-4108-aef8-2ad90760a201 on hv-cinder-85535 Sep 02 09:13:39.635994 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-e2608140-0418-4a7c-8077-14122d810f1a req-908e6247-77c9-4eaf-be13-4f4a7c4e86c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 Sep 02 09:13:39.636726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 351/722] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:40.448125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:40.448654 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:40.455446 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:40.455923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:40.456354 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:40.457037 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:40.457498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:40.457902 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:40.471659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] HTTP exception thrown: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Request method failure captured: Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 HTTP/1.1 Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgervgtx3-xa1JOOYa0SUQUztnVqJGlBd9J7kgpgeshuLR_549po5peVWxYPvf0tB5cEnlJq9rQmF7exnuEuLZTVzdHMZ1y4U4CzVIoK5Foe3v5R8WLTF7DyvbG9x4ufIKIQEKtbPX0WPBF39WuH8WZYS7V9HsdDWU1ievj4QuULm8 Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:13:40.473324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03f09713c2e45d9a261416a5dbd0883", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 10fcb673c54e484a88a0dabe7b8edb15 Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:13:40.474780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '5d6b1337-6402-4108-aef8-2ad90760a201'} Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:13:40.475676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:13:40.476918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:13:40.478084 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Returning 404 to user: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:13:40.478084 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-997179a6-e10d-41a1-9789-4487fe522160 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 404 len: 111 microversion: 2.20 time: 0.030619 Sep 02 09:13:40.478084 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 372/723] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:40 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 09:13:40.484238 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0a209718-6e46-4266-96bf-22076649549e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '.version_select at 0x7f54bc3caf70>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:40.503905 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0a209718-6e46-4266-96bf-22076649549e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-839942582" status: 204 len: 0 microversion: 2.20 time: 0.023945 Sep 02 09:13:40.504468 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 352/724] 10.222.0.36 () {60 vars in 1259 bytes} [Fri Sep 2 09:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-839942582 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 09:13:41.122578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c211e123-6914-4495-b2c2-e5387e36288e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'create', calling method: .version_select at 0x7f54bc40caf0>, body: {"keypair": {"name": "tempest-keypair-1341972648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmlOxw7v0II8i5D0SImkTIp8fe+zkWR3XtcHGN9kkGm7+jlkXA5a80VcwS+m+I8HVXKydb7mqZxPFjNbJfHqSdJ4NKj7LmMCF0sIsrTkRiEqhSL2zOBnLqRVDOenCHq4A=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:41.137838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-c211e123-6914-4495-b2c2-e5387e36288e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Getting quotas for project e03f09713c2e45d9a261416a5dbd0883. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:13:41.141546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-c211e123-6914-4495-b2c2-e5387e36288e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Getting quotas for user 10fcb673c54e484a88a0dabe7b8edb15 and project e03f09713c2e45d9a261416a5dbd0883. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:13:41.163045 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c211e123-6914-4495-b2c2-e5387e36288e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044325 Sep 02 09:13:41.163657 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 373/725] 10.222.0.36 () {62 vars in 1200 bytes} [Fri Sep 2 09:13:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 02 09:13:42.394966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2079449644", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "013e8f98-3f98-448f-a0f7-ca7e9e19c67d"}], "security_groups": [{"name": "tempest-securitygroup--1657345267"}], "key_name": "tempest-keypair-1341972648", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:42.495466 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] validate_networks() for [('013e8f98-3f98-448f-a0f7-ca7e9e19c67d', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:13:42.853609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:13:42.854027 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:13:42.854495 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:13:42.854898 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:13:42.855331 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:13:42.864467 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:42.864947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:42.865371 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:42.866083 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:42.866531 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:42.866947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:42.883186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Getting quotas for project e03f09713c2e45d9a261416a5dbd0883. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:13:42.886977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Getting quotas for user 10fcb673c54e484a88a0dabe7b8edb15 and project e03f09713c2e45d9a261416a5dbd0883. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:13:42.897938 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:13:42.900307 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:13:42.946323 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-50b4cd59-9cbb-4782-9a24-4ba7a2b73d63 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.556280 Sep 02 09:13:42.946963 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 353/726] 10.222.0.36 () {62 vars in 1188 bytes} [Fri Sep 2 09:13:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 09:13:42.959572 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bdc177d2-dd3b-4407-bdb6-eb2047fcec09 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:42.960753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bdc177d2-dd3b-4407-bdb6-eb2047fcec09 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:43.016398 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdc177d2-dd3b-4407-bdb6-eb2047fcec09 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:43.024259 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdc177d2-dd3b-4407-bdb6-eb2047fcec09 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:43.025710 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdc177d2-dd3b-4407-bdb6-eb2047fcec09 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:43.026762 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bdc177d2-dd3b-4407-bdb6-eb2047fcec09 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1282 microversion: 2.20 time: 0.072586 Sep 02 09:13:43.027332 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 374/727] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:42 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:44.050422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:44.051032 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:44.057290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:44.057776 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:44.058209 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:44.058899 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:44.059386 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:44.059805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:44.122503 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:44.131236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:44.132679 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:44.133756 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-792497bc-e3d4-4c4d-adff-f88e23248aa1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1278 microversion: 2.20 time: 0.087949 Sep 02 09:13:44.134310 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 354/728] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:44 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:45.156360 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:45.156959 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:45.163318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:45.163800 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:45.164233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:45.164913 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:45.165366 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:45.165789 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:45.255514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:45.263507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:45.264984 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:45.266087 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8ccd6311-978e-4eff-8de7-eb57d73ee036 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1340 microversion: 2.20 time: 0.113617 Sep 02 09:13:45.266649 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 375/729] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:45 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1340 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:46.135799 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0b26a35b-070e-46e6-a6f1-6e87d56d62e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:46.138153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0b26a35b-070e-46e6-a6f1-6e87d56d62e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:46.144533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b26a35b-070e-46e6-a6f1-6e87d56d62e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:46.145020 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b26a35b-070e-46e6-a6f1-6e87d56d62e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:46.145457 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b26a35b-070e-46e6-a6f1-6e87d56d62e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:46.146157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b26a35b-070e-46e6-a6f1-6e87d56d62e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:46.146614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b26a35b-070e-46e6-a6f1-6e87d56d62e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:46.147042 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b26a35b-070e-46e6-a6f1-6e87d56d62e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:46.177131 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0b26a35b-070e-46e6-a6f1-6e87d56d62e1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045074 Sep 02 09:13:46.178012 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 355/730] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:13:46 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:13:46.241859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:46.242378 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:46.248838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:46.249394 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:46.249835 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:46.250538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:46.250999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:46.251505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:46.278543 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:13:46.288630 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:46.289242 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:46.296169 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:46.296620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:46.297111 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:46.298097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:46.299132 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:46.299560 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:46.363576 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0a39b73f-69b6-485c-bc61-5659d1fce094 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 204 len: 0 microversion: 2.1 time: 0.125252 Sep 02 09:13:46.364438 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 376/731] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:13:46 2022] DELETE /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:13:46.372658 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:46.373360 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:46.380276 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:46.380974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:46.381413 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:46.382136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:46.382592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:46.383019 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:46.608803 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:46.616803 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:46.618569 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:46.619784 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-746e3589-d3c2-441b-907e-f9481fbcee82 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.335129 Sep 02 09:13:46.620403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 356/732] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:46 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:13:46.631589 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:46.639392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e1c08209-30ab-4b12-9437-db0b1a84db52 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1672 microversion: 2.1 time: 0.270632 Sep 02 09:13:46.639953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 377/733] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:46 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1672 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:47.641749 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:47.642866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:47.649247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:47.649724 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:47.650160 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:47.650848 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:47.651331 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:47.651751 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:47.661792 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:47.662418 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:47.668913 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:47.669424 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:47.669872 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:47.670573 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:47.671119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:47.671596 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:47.849291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:47.853428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:47.857274 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:47.858695 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:47.859815 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-17f606ea-0796-4d0a-abfe-b837c33d146d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.221990 Sep 02 09:13:47.860371 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 357/734] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:47 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:47.860931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-46332afc-0fd4-463a-8647-e74f7f80d0e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1672 microversion: 2.1 time: 0.203767 Sep 02 09:13:47.861487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 378/735] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:47 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:48.881769 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:48.888399 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:48.895398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:48.895890 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:48.896334 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:48.897097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:48.897866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:48.898864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:48.951529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:48.952168 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:48.958916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:48.959429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:48.959867 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:48.960547 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:48.961165 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:48.961773 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:48.984500 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:49.304391 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:49.312211 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8fe7a199-0ae6-4491-8c60-6b1b54637eaf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1672 microversion: 2.1 time: 0.434317 Sep 02 09:13:49.323528 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 358/736] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:48 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1672 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:49.327447 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:49.332781 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-3a3d5adc-02f9-49a5-978f-1f2b88bff506 req-5a41d8d3-7449-4e1c-8694-f7e167bc8604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde844d8-53ed-4ac1-813f-80203a754084", "tag": "d6bad915-ef87-444d-aa2b-102e8e9b311d"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:49.338709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:49.340106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:49.341598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7a2772ba-a112-4a27-9c46-c5ccefa4460c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.458267 Sep 02 09:13:49.342191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3a3d5adc-02f9-49a5-978f-1f2b88bff506 req-5a41d8d3-7449-4e1c-8694-f7e167bc8604 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:49.342665 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3a3d5adc-02f9-49a5-978f-1f2b88bff506 req-5a41d8d3-7449-4e1c-8694-f7e167bc8604 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:49.343319 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3a3d5adc-02f9-49a5-978f-1f2b88bff506 req-5a41d8d3-7449-4e1c-8694-f7e167bc8604 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:49.354692 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-3a3d5adc-02f9-49a5-978f-1f2b88bff506 req-5a41d8d3-7449-4e1c-8694-f7e167bc8604 service nova] Creating event network-changed:d6bad915-ef87-444d-aa2b-102e8e9b311d for instance dde844d8-53ed-4ac1-813f-80203a754084 on hv-cinder-85535 Sep 02 09:13:49.355060 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 379/737] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:48 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:49.360816 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-3a3d5adc-02f9-49a5-978f-1f2b88bff506 req-5a41d8d3-7449-4e1c-8694-f7e167bc8604 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035973 Sep 02 09:13:49.362996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 359/738] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:50.366162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:50.367718 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:50.378477 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:50.379356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:50.380335 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:50.381308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:50.383997 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:50.385340 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:50.489532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:50.490724 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:50.496903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:50.497399 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:50.497922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:50.498909 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:50.499547 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:50.500130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:50.532406 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:50.542931 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:50.545884 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:50.547016 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d042be2-5157-481c-9ba6-c2f13173eec9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.186093 Sep 02 09:13:50.547891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 360/739] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:50 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:13:50.562485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:50.570978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d28f2548-5f34-461c-90a7-31ecb4d480bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1605 microversion: 2.1 time: 0.235790 Sep 02 09:13:50.571571 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 380/740] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:50 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1605 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:51.421443 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-bcb6a352-741d-411e-a977-0d6986bb860d req-c451cd46-af16-4bdc-b26e-9f3f74ae5d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c2d542-631f-4763-84db-ce759de2b8d8", "name": "network-vif-deleted", "tag": "940c2d3a-4b9a-44d0-ace9-56e2f3dd7348"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:51.431002 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bcb6a352-741d-411e-a977-0d6986bb860d req-c451cd46-af16-4bdc-b26e-9f3f74ae5d4f service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:51.431508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bcb6a352-741d-411e-a977-0d6986bb860d req-c451cd46-af16-4bdc-b26e-9f3f74ae5d4f service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:51.431937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bcb6a352-741d-411e-a977-0d6986bb860d req-c451cd46-af16-4bdc-b26e-9f3f74ae5d4f service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:51.442302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-bcb6a352-741d-411e-a977-0d6986bb860d req-c451cd46-af16-4bdc-b26e-9f3f74ae5d4f service nova] Creating event network-vif-deleted:940c2d3a-4b9a-44d0-ace9-56e2f3dd7348 for instance 06c2d542-631f-4763-84db-ce759de2b8d8 on hv-cinder-85535 Sep 02 09:13:51.446876 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-bcb6a352-741d-411e-a977-0d6986bb860d req-c451cd46-af16-4bdc-b26e-9f3f74ae5d4f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029039 Sep 02 09:13:51.447500 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 361/741] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:51.570226 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:51.570770 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:51.573029 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:51.578186 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:51.578930 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:51.579407 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:51.580691 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:51.581139 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:51.581557 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:51.592562 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:51.593257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:51.599290 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:51.599774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:51.600208 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:51.600891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:51.601343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:51.601764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:51.632400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:51.633159 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:51.633311 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:51.633754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lazy-loading 'fault' on Instance uuid 06c2d542-631f-4763-84db-ce759de2b8d8 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:13:51.685511 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:51.692974 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5b078d78-b609-4cb9-a97e-4edb70b5ddc9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 200 len: 1327 microversion: 2.1 time: 0.104544 Sep 02 09:13:51.693740 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 362/742] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:51 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:51.801734 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:51.810013 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:51.811456 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:51.812552 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bdcecbaf-5078-4c27-9e33-08aebdba9ce3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.246224 Sep 02 09:13:51.813109 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 381/743] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:51 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:52.715096 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:52.715722 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:52.722173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:52.722655 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:52.723113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:52.723805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:52.724266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:52.724692 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:52.738083 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] HTTP exception thrown: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Request method failure captured: Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 HTTP/1.1 Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcggL-twjMvPeUaoCJUJ9btABS--Chtf9joKHOz6WvMDeaMrH9dRCpgQHb0ACnnJGJkfU6Zta7tElnUv2Y63gxDd66dxppfA0PxPx48ZH_YXlJuTxngAO3jdijPWspPKdJLf8MwBpsaDOIgV0vtjhOaMRyTYSWQQNOf5whbU9UHNjo0 Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:13:52.739713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2d6a6fe5db0a452a83dde4aac26b0161", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 4210f948dc7e4a5bac61d10eb6a62eee Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:13:52.741328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '06c2d542-631f-4763-84db-ce759de2b8d8'} Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:13:52.742260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:13:52.743775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:13:52.745161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Returning 404 to user: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:13:52.745161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bca9d951-3be5-4158-87ec-498e55fdad73 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 404 len: 111 microversion: 2.1 time: 0.029922 Sep 02 09:13:52.745161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 363/744] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:52 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:13:52.749695 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8a13ebac-9003-4607-8ce3-b80654b196e6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '.version_select at 0x7f54bc3a43a0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:52.768080 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8a13ebac-9003-4607-8ce3-b80654b196e6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759316574" status: 202 len: 0 microversion: 2.1 time: 0.021963 Sep 02 09:13:52.768626 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 382/745] 10.222.0.36 () {58 vars in 1221 bytes} [Fri Sep 2 09:13:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759316574 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:13:52.836543 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:52.837182 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:52.843043 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:52.843560 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:52.843996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:52.844690 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:52.845143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:52.845565 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:52.875109 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:52.894279 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:52.998921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:53.007676 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:53.009081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:53.010164 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fadc88c9-2296-41a7-a686-559de8624ede tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.177555 Sep 02 09:13:53.010715 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 364/746] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:52 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:53.418689 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:53.422694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7fd7694f-f4c2-4c10-8ed2-bf9dd14fbc9c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'create', calling method: .version_select at 0x7f54bc40ca60>, body: {"keypair": {"name": "tempest-keypair-618606796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnb/HrpcwliFh67fCSBK+vmI+zuGabP2RC8/Q/Szqk/MCoa7E0DnmpHW1uiAjKHXT5oBJcSfnLGOmMbzNp+67O0UI2x/P+UjIPk4Tkn7h6xT3ha3ia/XfjGbzVBwXVJCg=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:53.441085 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-7fd7694f-f4c2-4c10-8ed2-bf9dd14fbc9c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Getting quotas for project 2d6a6fe5db0a452a83dde4aac26b0161. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:13:53.444853 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-7fd7694f-f4c2-4c10-8ed2-bf9dd14fbc9c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Getting quotas for user 4210f948dc7e4a5bac61d10eb6a62eee and project 2d6a6fe5db0a452a83dde4aac26b0161. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:13:53.465919 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7fd7694f-f4c2-4c10-8ed2-bf9dd14fbc9c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047968 Sep 02 09:13:53.466506 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 383/747] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:13:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:54.045918 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:54.046461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:54.053068 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:54.053670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:54.054227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:54.054921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:54.055400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:54.055822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:54.197155 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:54.205413 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:54.207121 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:54.208246 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-371c9361-777a-43c8-b3c2-babc8f0c2479 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.166363 Sep 02 09:13:54.208793 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 365/748] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:54 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:54.701487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1717591640", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0e88d96-5a33-4925-b573-ee1c7dbbf348"}], "security_groups": [{"name": "tempest-securitygroup--2056503410"}], "key_name": "tempest-keypair-618606796", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:54.800135 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] validate_networks() for [('f0e88d96-5a33-4925-b573-ee1c7dbbf348', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:13:55.201090 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:13:55.201515 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:13:55.201986 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:13:55.202396 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:13:55.202805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:13:55.212458 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:55.212943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:55.213378 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:55.214103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:55.214559 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:55.214985 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:55.229805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:55.230497 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:55.231265 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Getting quotas for project 2d6a6fe5db0a452a83dde4aac26b0161. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:13:55.235242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Getting quotas for user 4210f948dc7e4a5bac61d10eb6a62eee and project 2d6a6fe5db0a452a83dde4aac26b0161. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:13:55.237470 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:55.238023 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:55.238530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:55.239327 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:55.239882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:55.240374 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:55.246526 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:13:55.248855 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:13:55.297665 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-59347ff7-e575-4c1d-9834-aec0e92fc4f9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.601128 Sep 02 09:13:55.298318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 384/749] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:13:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:13:55.310691 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3517766b-6605-44c4-831a-3001412319ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:55.311337 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3517766b-6605-44c4-831a-3001412319ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:55.384843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3517766b-6605-44c4-831a-3001412319ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:55.391599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3517766b-6605-44c4-831a-3001412319ec tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1237 microversion: 2.1 time: 0.084981 Sep 02 09:13:55.399302 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 385/750] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:55 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:55.418080 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:55.426822 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:55.428318 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:55.429419 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5026ce16-5e12-449d-bd64-9bcfea43684f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.203526 Sep 02 09:13:55.429970 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 366/751] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:55 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:55.654016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-98c433a2-db02-4322-80d9-a90f1d57a9f2 req-fe08fbbe-8a59-482b-97e8-3846de5a0619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde844d8-53ed-4ac1-813f-80203a754084", "name": "network-vif-plugged", "status": "completed", "tag": "d6bad915-ef87-444d-aa2b-102e8e9b311d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:55.665264 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-98c433a2-db02-4322-80d9-a90f1d57a9f2 req-fe08fbbe-8a59-482b-97e8-3846de5a0619 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:55.665764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-98c433a2-db02-4322-80d9-a90f1d57a9f2 req-fe08fbbe-8a59-482b-97e8-3846de5a0619 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:55.666206 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-98c433a2-db02-4322-80d9-a90f1d57a9f2 req-fe08fbbe-8a59-482b-97e8-3846de5a0619 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:55.677249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-98c433a2-db02-4322-80d9-a90f1d57a9f2 req-fe08fbbe-8a59-482b-97e8-3846de5a0619 service nova] Creating event network-vif-plugged:d6bad915-ef87-444d-aa2b-102e8e9b311d for instance dde844d8-53ed-4ac1-813f-80203a754084 on hv-cinder-85535 Sep 02 09:13:55.682265 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-98c433a2-db02-4322-80d9-a90f1d57a9f2 req-fe08fbbe-8a59-482b-97e8-3846de5a0619 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 Sep 02 09:13:55.683106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 386/752] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:56.412128 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:56.412670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:56.415482 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:56.421465 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:56.421953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:56.422391 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:56.423107 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:56.424075 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:56.424517 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:56.452729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:56.453420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:56.459794 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:56.460269 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:56.460699 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:56.461401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:56.461850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:56.462276 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:56.487263 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:56.494820 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c1393543-2be8-4190-bea0-114b6f54f24d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1289 microversion: 2.1 time: 0.086600 Sep 02 09:13:56.495413 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 367/753] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:56 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:56.591413 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:56.599379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:56.600816 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:56.601918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7fe63679-51ff-4f38-9067-e839a4710461 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.153945 Sep 02 09:13:56.602475 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 387/754] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:56 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:57.153012 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37701f5d-c4aa-4999-8404-fdf41938e293 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:57.153532 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-37701f5d-c4aa-4999-8404-fdf41938e293 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:57.160008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37701f5d-c4aa-4999-8404-fdf41938e293 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:57.160487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37701f5d-c4aa-4999-8404-fdf41938e293 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:57.160918 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37701f5d-c4aa-4999-8404-fdf41938e293 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:57.161594 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37701f5d-c4aa-4999-8404-fdf41938e293 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:57.162044 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37701f5d-c4aa-4999-8404-fdf41938e293 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:57.162461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37701f5d-c4aa-4999-8404-fdf41938e293 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:57.184355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-37701f5d-c4aa-4999-8404-fdf41938e293 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/ips" status: 200 len: 150 microversion: 2.1 time: 0.089293 Sep 02 09:13:57.184893 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 368/755] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:13:57 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/ips => generated 150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:57.516031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:57.516642 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:57.523651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:57.524130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:57.524561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:57.525247 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:57.525702 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:57.526124 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:57.586374 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:57.593783 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a9bf4ba9-59da-418e-8714-95ce90cadfdb tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1289 microversion: 2.1 time: 0.081634 Sep 02 09:13:57.594340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 388/756] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:57 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1289 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:13:57.625254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:57.625950 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:57.633376 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:57.633858 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:57.634297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:57.635035 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:57.635521 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:57.635947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:57.764866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:57.773706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:57.775255 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:57.776367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0e4e4cc2-9826-4bf9-8475-475cd7ed89c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1408 microversion: 2.20 time: 0.155393 Sep 02 09:13:57.776931 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 369/757] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:57 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:13:58.505826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e0a44104-ba19-44c8-a81f-ff7a31b91e25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "079d7b45-5239-4369-a152-670d38e47c33"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:58.508347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e0a44104-ba19-44c8-a81f-ff7a31b91e25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:58.514401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0a44104-ba19-44c8-a81f-ff7a31b91e25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:58.514883 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0a44104-ba19-44c8-a81f-ff7a31b91e25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:58.515349 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0a44104-ba19-44c8-a81f-ff7a31b91e25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:58.516040 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0a44104-ba19-44c8-a81f-ff7a31b91e25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:58.516491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0a44104-ba19-44c8-a81f-ff7a31b91e25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:58.517179 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0a44104-ba19-44c8-a81f-ff7a31b91e25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:58.614823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:58.615474 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:58.621990 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:58.622495 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:58.622941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:58.623693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:58.624154 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:58.624590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:58.694656 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:58.697123 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:13:58.705495 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5364c4ad-b2f1-4d55-b7ca-89a26227a075 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1295 microversion: 2.1 time: 0.094416 Sep 02 09:13:58.718794 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 370/758] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:58 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:13:58.797671 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:58.798279 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:58.807240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:58.808015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:58.808397 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:58.809280 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:58.809908 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:58.810345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:58.823679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e0a44104-ba19-44c8-a81f-ff7a31b91e25 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321354 Sep 02 09:13:58.824596 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 389/759] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:13:58 2022] POST /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:13:59.032504 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:59.043511 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:59.045326 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:59.046472 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-13f7b0e7-c24b-4543-ac09-59458bb13a24 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1599 microversion: 2.20 time: 0.252913 Sep 02 09:13:59.047024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 371/760] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:13:58 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1599 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:13:59.069291 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25c7903c-7950-43fe-abdf-1d7a18ca6efc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:59.069871 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25c7903c-7950-43fe-abdf-1d7a18ca6efc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:59.076773 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25c7903c-7950-43fe-abdf-1d7a18ca6efc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:59.077249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25c7903c-7950-43fe-abdf-1d7a18ca6efc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:59.077710 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25c7903c-7950-43fe-abdf-1d7a18ca6efc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:59.078398 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25c7903c-7950-43fe-abdf-1d7a18ca6efc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:59.079154 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25c7903c-7950-43fe-abdf-1d7a18ca6efc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:59.079598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25c7903c-7950-43fe-abdf-1d7a18ca6efc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:59.192622 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25c7903c-7950-43fe-abdf-1d7a18ca6efc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128259 Sep 02 09:13:59.193170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 390/761] 10.222.0.36 () {60 vars in 1316 bytes} [Fri Sep 2 09:13:59 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:13:59.641939 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-719bfc8a-0810-46fa-9f29-86cd5749c5ab req-fd58727b-3c46-4ad1-9771-6cf4eabcdda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9945d695-4910-47a7-85df-8eedda254a17", "tag": "0d64b912-fc8e-4641-b22d-7c0cc297786c"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:13:59.655030 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-719bfc8a-0810-46fa-9f29-86cd5749c5ab req-fd58727b-3c46-4ad1-9771-6cf4eabcdda2 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:59.655546 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-719bfc8a-0810-46fa-9f29-86cd5749c5ab req-fd58727b-3c46-4ad1-9771-6cf4eabcdda2 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:59.656165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-719bfc8a-0810-46fa-9f29-86cd5749c5ab req-fd58727b-3c46-4ad1-9771-6cf4eabcdda2 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:59.670205 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-719bfc8a-0810-46fa-9f29-86cd5749c5ab req-fd58727b-3c46-4ad1-9771-6cf4eabcdda2 service nova] Creating event network-changed:0d64b912-fc8e-4641-b22d-7c0cc297786c for instance 9945d695-4910-47a7-85df-8eedda254a17 on hv-cinder-85535 Sep 02 09:13:59.675673 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-719bfc8a-0810-46fa-9f29-86cd5749c5ab req-fd58727b-3c46-4ad1-9771-6cf4eabcdda2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037274 Sep 02 09:13:59.679179 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 372/762] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:13:59.726310 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:13:59.726916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:13:59.733092 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:59.733572 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:59.734273 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:59.734954 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:13:59.735439 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:13:59.735856 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:13:59.954201 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:13:59.965873 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4218fb57-12f9-40ce-9d6d-22513ae163cf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1363 microversion: 2.1 time: 0.243695 Sep 02 09:13:59.966550 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 391/763] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:13:59 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:00.143018 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-03b88479-7b37-4c7b-8aa2-5b224d88020f req-9e03cdd3-646e-49e7-9e84-e56c7ca7310a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde844d8-53ed-4ac1-813f-80203a754084", "tag": "d6bad915-ef87-444d-aa2b-102e8e9b311d"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:00.152544 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-03b88479-7b37-4c7b-8aa2-5b224d88020f req-9e03cdd3-646e-49e7-9e84-e56c7ca7310a service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:00.153032 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-03b88479-7b37-4c7b-8aa2-5b224d88020f req-9e03cdd3-646e-49e7-9e84-e56c7ca7310a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:00.153464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-03b88479-7b37-4c7b-8aa2-5b224d88020f req-9e03cdd3-646e-49e7-9e84-e56c7ca7310a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:00.164968 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-03b88479-7b37-4c7b-8aa2-5b224d88020f req-9e03cdd3-646e-49e7-9e84-e56c7ca7310a service nova] Creating event network-changed:d6bad915-ef87-444d-aa2b-102e8e9b311d for instance dde844d8-53ed-4ac1-813f-80203a754084 on hv-cinder-85535 Sep 02 09:14:00.170146 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-03b88479-7b37-4c7b-8aa2-5b224d88020f req-9e03cdd3-646e-49e7-9e84-e56c7ca7310a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031523 Sep 02 09:14:00.170745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 373/764] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:00.987519 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:00.988130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:00.995031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:00.995671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:00.996173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:00.996931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:00.997455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:00.997935 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:01.140792 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:01.148956 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f38e719a-3cfc-4def-94e0-cc09687d787c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1363 microversion: 2.1 time: 0.165317 Sep 02 09:14:01.149531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 392/765] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:00 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:02.171195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:02.171821 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:02.178622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:02.179144 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:02.179611 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:02.180299 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:02.180759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:02.181184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:02.306781 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:02.314812 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-429fc226-8932-4e7a-be66-ab0a8740039f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1363 microversion: 2.1 time: 0.148459 Sep 02 09:14:02.315464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 374/766] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:02 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:03.336054 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:03.336700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:03.343299 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:03.343722 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:03.344157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:03.344847 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:03.345302 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:03.346340 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:03.471404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:03.478801 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34ee2ef2-919c-4dd4-90c2-0813200c99fd tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1363 microversion: 2.1 time: 0.146530 Sep 02 09:14:03.479402 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 393/767] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:03 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:04.499309 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:04.499939 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:04.505862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:04.506342 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:04.506774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:04.507483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:04.507936 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:04.508360 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:04.635307 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:04.642733 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e12a4c2f-f52e-4fb3-9bb1-f3dbc0e31c0c tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1363 microversion: 2.1 time: 0.147475 Sep 02 09:14:04.644075 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 375/768] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:04 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:05.665597 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:05.666232 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:05.668679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:05.669348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=12 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:05.675494 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:05.675988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:05.676473 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:05.677193 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:05.678311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:05.678748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:05.711307 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-1e7d5d20-10c2-4da1-8107-17b6cf6ee45b req-1521cc21-0388-48a8-9a32-6f1c27c264eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9945d695-4910-47a7-85df-8eedda254a17", "name": "network-vif-plugged", "status": "completed", "tag": "0d64b912-fc8e-4641-b22d-7c0cc297786c"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:05.727450 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-1e7d5d20-10c2-4da1-8107-17b6cf6ee45b req-1521cc21-0388-48a8-9a32-6f1c27c264eb service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:05.728116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-1e7d5d20-10c2-4da1-8107-17b6cf6ee45b req-1521cc21-0388-48a8-9a32-6f1c27c264eb service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:05.728484 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-1e7d5d20-10c2-4da1-8107-17b6cf6ee45b req-1521cc21-0388-48a8-9a32-6f1c27c264eb service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:05.740629 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-1e7d5d20-10c2-4da1-8107-17b6cf6ee45b req-1521cc21-0388-48a8-9a32-6f1c27c264eb service nova] Creating event network-vif-plugged:0d64b912-fc8e-4641-b22d-7c0cc297786c for instance 9945d695-4910-47a7-85df-8eedda254a17 on hv-cinder-85535 Sep 02 09:14:05.749746 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-1e7d5d20-10c2-4da1-8107-17b6cf6ee45b req-1521cc21-0388-48a8-9a32-6f1c27c264eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041753 Sep 02 09:14:05.750891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 376/769] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:14:05.846811 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:05.854407 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-996c5920-b633-4f33-b890-4399dcbea0c6 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1363 microversion: 2.1 time: 0.192744 Sep 02 09:14:05.854980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 394/770] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:05 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:06.371469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "079d7b45-5239-4369-a152-670d38e47c33"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:06.373897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:06.380691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:06.381169 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:06.381597 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:06.382269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:06.382715 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:06.383152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:06.459454 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Invalid volume: volume 079d7b45-5239-4369-a152-670d38e47c33 is already attached to instances: 84250eef-a56f-4e60-bbdc-95143e398d49 Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments HTTP/1.1 Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 74 Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:14:06.461138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {"volumeAttachment": {"volumeId": "079d7b45-5239-4369-a152-670d38e47c33"}} Sep 02 09:14:06.462705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Invalid volume: volume 079d7b45-5239-4369-a152-670d38e47c33 is already attached to instances: 84250eef-a56f-4e60-bbdc-95143e398d49 Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'server_id': '84250eef-a56f-4e60-bbdc-95143e398d49', 'body': {'volumeAttachment': {'volumeId': '079d7b45-5239-4369-a152-670d38e47c33'}}} Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 079d7b45-5239-4369-a152-670d38e47c33 is already attached to instances: 84250eef-a56f-4e60-bbdc-95143e398d49 Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:06.463653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 079d7b45-5239-4369-a152-670d38e47c33 is already attached to instances: 84250eef-a56f-4e60-bbdc-95143e398d49 Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:06.465015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:06.466418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:06.466418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:14:06.466418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:14:06.466418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 079d7b45-5239-4369-a152-670d38e47c33 is already attached to instances: 84250eef-a56f-4e60-bbdc-95143e398d49 Sep 02 09:14:06.466418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:06.466418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 400 to user: Invalid volume: volume 079d7b45-5239-4369-a152-670d38e47c33 is already attached to instances: 84250eef-a56f-4e60-bbdc-95143e398d49 {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:14:06.466418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e2334b69-1078-4202-a5fc-f31f6a07e247 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095718 Sep 02 09:14:06.466418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 377/771] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:14:06 2022] POST /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:14:06.524518 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:06.525020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:06.530841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:06.531361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:06.531802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:06.532495 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:06.532955 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:06.533381 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:06.611592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lazy-loading 'services' on Instance uuid 84250eef-a56f-4e60-bbdc-95143e398d49 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:14:06.682271 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a812be9b-1fea-44fb-96f6-5fc3c21bd745 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments/079d7b45-5239-4369-a152-670d38e47c33" status: 202 len: 0 microversion: 2.1 time: 0.161442 Sep 02 09:14:06.682917 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 395/772] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:14:06 2022] DELETE /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments/079d7b45-5239-4369-a152-670d38e47c33 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:14:06.691488 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8d04f4e3-f67e-487e-b1c6-316e42297e28 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:06.693581 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8d04f4e3-f67e-487e-b1c6-316e42297e28 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:06.699348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d04f4e3-f67e-487e-b1c6-316e42297e28 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:06.699827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d04f4e3-f67e-487e-b1c6-316e42297e28 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:06.700257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d04f4e3-f67e-487e-b1c6-316e42297e28 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:06.700937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d04f4e3-f67e-487e-b1c6-316e42297e28 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:06.701384 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d04f4e3-f67e-487e-b1c6-316e42297e28 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:06.701802 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d04f4e3-f67e-487e-b1c6-316e42297e28 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:06.733052 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8d04f4e3-f67e-487e-b1c6-316e42297e28 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Sep 02 09:14:06.733622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 378/773] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:14:06 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:06.875609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:06.876320 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:06.883254 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:06.883748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:06.884199 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:06.884898 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:06.885357 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:06.885787 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:07.022915 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:07.030577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b49d7c31-521b-4bf1-9950-8e713d970fd1 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1363 microversion: 2.1 time: 0.159314 Sep 02 09:14:07.031172 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 396/774] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:06 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:07.745276 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ae427e7e-dd8d-4462-a7e2-f17070761f65 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:07.747474 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ae427e7e-dd8d-4462-a7e2-f17070761f65 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:07.753890 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae427e7e-dd8d-4462-a7e2-f17070761f65 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:07.754366 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae427e7e-dd8d-4462-a7e2-f17070761f65 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:07.754796 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae427e7e-dd8d-4462-a7e2-f17070761f65 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:07.755509 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae427e7e-dd8d-4462-a7e2-f17070761f65 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:07.755966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae427e7e-dd8d-4462-a7e2-f17070761f65 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:07.756394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae427e7e-dd8d-4462-a7e2-f17070761f65 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:07.785520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ae427e7e-dd8d-4462-a7e2-f17070761f65 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Sep 02 09:14:07.786063 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 379/775] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:14:07 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:08.051134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:08.051660 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:08.058110 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.058604 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.059109 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.059802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.060304 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.060728 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.191188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:08.198748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-21135ed4-e62b-4614-ab83-3dba2e20ac28 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1549 microversion: 2.1 time: 0.151578 Sep 02 09:14:08.199468 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 397/776] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:08 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:08.221293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c489c9d4-a734-4a07-8553-22adb4f242ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:08.221410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c489c9d4-a734-4a07-8553-22adb4f242ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:08.227374 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c489c9d4-a734-4a07-8553-22adb4f242ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.227864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c489c9d4-a734-4a07-8553-22adb4f242ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.228301 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c489c9d4-a734-4a07-8553-22adb4f242ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.229001 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c489c9d4-a734-4a07-8553-22adb4f242ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.229466 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c489c9d4-a734-4a07-8553-22adb4f242ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.229882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c489c9d4-a734-4a07-8553-22adb4f242ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.564201 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c489c9d4-a734-4a07-8553-22adb4f242ba tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.347314 Sep 02 09:14:08.564980 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 380/777] 10.222.0.36 () {58 vars in 1275 bytes} [Fri Sep 2 09:14:08 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-interface => generated 285 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:08.672218 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:08.672718 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:08.678660 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.679178 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.679614 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.680299 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.680778 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.681199 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.761674 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:08.765988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lazy-loading 'services' on Instance uuid 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:14:08.800075 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bf9d4c0d-8658-4f1e-93c6-a518e3276b23 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:08.802385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bf9d4c0d-8658-4f1e-93c6-a518e3276b23 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:08.808645 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf9d4c0d-8658-4f1e-93c6-a518e3276b23 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.809136 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf9d4c0d-8658-4f1e-93c6-a518e3276b23 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.809759 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf9d4c0d-8658-4f1e-93c6-a518e3276b23 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.810647 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf9d4c0d-8658-4f1e-93c6-a518e3276b23 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.811359 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf9d4c0d-8658-4f1e-93c6-a518e3276b23 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.811810 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf9d4c0d-8658-4f1e-93c6-a518e3276b23 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.848208 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b58288b4-7488-4499-9a82-7b0d22d32360 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "DELETE /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments/99605215-941c-4177-bbbb-763763d4607f" status: 202 len: 0 microversion: 2.1 time: 0.179617 Sep 02 09:14:08.849134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 398/778] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:14:08 2022] DELETE /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments/99605215-941c-4177-bbbb-763763d4607f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 09:14:08.850623 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bf9d4c0d-8658-4f1e-93c6-a518e3276b23 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056585 Sep 02 09:14:08.851317 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 381/779] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:14:08 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 09:14:08.860486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7a67cbfa-b199-449f-940b-104eeab4c9a1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:08.863380 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7a67cbfa-b199-449f-940b-104eeab4c9a1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:08.871244 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a67cbfa-b199-449f-940b-104eeab4c9a1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.871879 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a67cbfa-b199-449f-940b-104eeab4c9a1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.872447 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a67cbfa-b199-449f-940b-104eeab4c9a1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.873446 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a67cbfa-b199-449f-940b-104eeab4c9a1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.874037 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a67cbfa-b199-449f-940b-104eeab4c9a1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.874673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a67cbfa-b199-449f-940b-104eeab4c9a1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.912789 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7a67cbfa-b199-449f-940b-104eeab4c9a1 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058186 Sep 02 09:14:08.913711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 399/780] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:14:08 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:08.920376 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:08.921201 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:08.927726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.928326 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.928767 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.929479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:08.929936 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:08.930362 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:08.960401 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:14:09.045351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fd430a18-613a-47fc-b0d7-28f41c254796 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 204 len: 0 microversion: 2.1 time: 0.133693 Sep 02 09:14:09.045948 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 382/781] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:14:08 2022] DELETE /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:14:09.054130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:09.054738 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:09.061118 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:09.061599 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:09.062026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:09.062718 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:09.063205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:09.063629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:09.196018 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:09.203662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c828928d-d429-410d-9787-55ecc6c61e1e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1682 microversion: 2.1 time: 0.153384 Sep 02 09:14:09.204494 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 400/782] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:09 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:09.790417 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-abfbc476-0c6b-4bfd-bd94-4d115017d054 req-ea41b098-1448-4cc6-adc0-e8d882cdd828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9945d695-4910-47a7-85df-8eedda254a17", "tag": "0d64b912-fc8e-4641-b22d-7c0cc297786c"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:09.800726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-abfbc476-0c6b-4bfd-bd94-4d115017d054 req-ea41b098-1448-4cc6-adc0-e8d882cdd828 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:09.801357 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-abfbc476-0c6b-4bfd-bd94-4d115017d054 req-ea41b098-1448-4cc6-adc0-e8d882cdd828 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:09.801621 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-abfbc476-0c6b-4bfd-bd94-4d115017d054 req-ea41b098-1448-4cc6-adc0-e8d882cdd828 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:09.812551 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-abfbc476-0c6b-4bfd-bd94-4d115017d054 req-ea41b098-1448-4cc6-adc0-e8d882cdd828 service nova] Creating event network-changed:0d64b912-fc8e-4641-b22d-7c0cc297786c for instance 9945d695-4910-47a7-85df-8eedda254a17 on hv-cinder-85535 Sep 02 09:14:09.817899 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-abfbc476-0c6b-4bfd-bd94-4d115017d054 req-ea41b098-1448-4cc6-adc0-e8d882cdd828 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087921 Sep 02 09:14:09.818708 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 383/783] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:14:09.926191 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1414c3e5-83cc-4080-9ddc-319b10bdf917 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:09.928518 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1414c3e5-83cc-4080-9ddc-319b10bdf917 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:09.934393 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1414c3e5-83cc-4080-9ddc-319b10bdf917 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:09.934878 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1414c3e5-83cc-4080-9ddc-319b10bdf917 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:09.935348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1414c3e5-83cc-4080-9ddc-319b10bdf917 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:09.936038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1414c3e5-83cc-4080-9ddc-319b10bdf917 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:09.936495 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1414c3e5-83cc-4080-9ddc-319b10bdf917 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:09.936919 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1414c3e5-83cc-4080-9ddc-319b10bdf917 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:09.966298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1414c3e5-83cc-4080-9ddc-319b10bdf917 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044526 Sep 02 09:14:09.966890 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 401/784] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:14:09 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:10.225653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:10.226280 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:10.232566 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:10.233056 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:10.233493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:10.234187 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:10.234640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:10.235063 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:10.366126 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:10.374212 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4805d6e4-03f6-4af2-bcb7-daf702da22ae tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1682 microversion: 2.1 time: 0.153503 Sep 02 09:14:10.374783 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 384/785] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:10 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:10.978233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-83035132-86a7-4ac5-a002-c5e9096cd21f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:10.980459 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-83035132-86a7-4ac5-a002-c5e9096cd21f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:10.986902 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83035132-86a7-4ac5-a002-c5e9096cd21f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:10.987424 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83035132-86a7-4ac5-a002-c5e9096cd21f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:10.987863 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83035132-86a7-4ac5-a002-c5e9096cd21f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:10.988558 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83035132-86a7-4ac5-a002-c5e9096cd21f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:10.989635 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83035132-86a7-4ac5-a002-c5e9096cd21f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:10.989987 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83035132-86a7-4ac5-a002-c5e9096cd21f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:11.019386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-83035132-86a7-4ac5-a002-c5e9096cd21f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044906 Sep 02 09:14:11.019868 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 402/786] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:14:10 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:11.397366 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:11.398764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:11.406606 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:11.407112 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:11.407573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:11.408266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:11.409564 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:11.410008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:11.692506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:11.702075 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5bee3d16-e307-4500-9ed9-2e2a6d4508aa tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1682 microversion: 2.1 time: 0.310755 Sep 02 09:14:11.702749 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 385/787] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:11 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1682 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:12.031089 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4d557878-db6a-4bf0-b300-537a548f0058 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:12.033296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4d557878-db6a-4bf0-b300-537a548f0058 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:12.039719 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d557878-db6a-4bf0-b300-537a548f0058 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:12.040216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d557878-db6a-4bf0-b300-537a548f0058 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:12.040658 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d557878-db6a-4bf0-b300-537a548f0058 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:12.041361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d557878-db6a-4bf0-b300-537a548f0058 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:12.041823 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d557878-db6a-4bf0-b300-537a548f0058 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:12.042254 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d557878-db6a-4bf0-b300-537a548f0058 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:12.071200 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4d557878-db6a-4bf0-b300-537a548f0058 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044033 Sep 02 09:14:12.071775 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 403/788] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:14:12 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:14:12.146637 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:12.146895 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:12.152601 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:12.153080 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:12.153511 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:12.154192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:12.154640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:12.155058 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:12.180267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:14:12.258608 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-00f48013-e37c-4759-9f6d-f6628f6ad285 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "DELETE /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 204 len: 0 microversion: 2.1 time: 0.115785 Sep 02 09:14:12.259715 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 386/789] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:14:12 2022] DELETE /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:14:12.268372 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:12.268848 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:12.274882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:12.275405 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:12.275845 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:12.276550 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:12.277008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:12.277433 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:12.494962 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:12.502698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f4c93063-cbc4-4715-b232-249513e6f869 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1691 microversion: 2.1 time: 0.239212 Sep 02 09:14:12.503370 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 404/790] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:12 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1691 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:12.668097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-d425c4ee-2e71-4c4e-a776-3678334ef30e req-59eb50b0-9f4c-478a-9b0b-5d7418fc2f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84250eef-a56f-4e60-bbdc-95143e398d49", "name": "network-vif-deleted", "tag": "4b639641-fe71-4e82-bc3f-342eee50c5c3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:12.682259 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d425c4ee-2e71-4c4e-a776-3678334ef30e req-59eb50b0-9f4c-478a-9b0b-5d7418fc2f18 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:12.682940 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d425c4ee-2e71-4c4e-a776-3678334ef30e req-59eb50b0-9f4c-478a-9b0b-5d7418fc2f18 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:12.683571 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d425c4ee-2e71-4c4e-a776-3678334ef30e req-59eb50b0-9f4c-478a-9b0b-5d7418fc2f18 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:12.686590 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:12.698145 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-d425c4ee-2e71-4c4e-a776-3678334ef30e req-59eb50b0-9f4c-478a-9b0b-5d7418fc2f18 service nova] Creating event network-vif-deleted:4b639641-fe71-4e82-bc3f-342eee50c5c3 for instance 84250eef-a56f-4e60-bbdc-95143e398d49 on hv-cinder-85535 Sep 02 09:14:12.703461 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-d425c4ee-2e71-4c4e-a776-3678334ef30e req-59eb50b0-9f4c-478a-9b0b-5d7418fc2f18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104080 Sep 02 09:14:12.704494 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 387/791] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:12.724954 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:12.725918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:12.733465 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:12.734031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:12.734544 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:12.735359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:12.735927 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:12.736466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:12.800414 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:12.808061 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-38c75f52-f176-43e3-ad0a-3a37e8849d3f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1614 microversion: 2.1 time: 0.087713 Sep 02 09:14:12.808621 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 405/792] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:12 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:13.525750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:13.526359 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:13.533315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:13.533971 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:13.534405 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:13.535115 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:13.535579 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:13.536003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:13.669669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:13.677369 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b9187eba-2a74-4ea0-8661-f4ec4ba98018 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1691 microversion: 2.1 time: 0.157035 Sep 02 09:14:13.677931 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 388/793] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:13 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:13.830068 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:13.831166 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:13.837484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:13.837953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:13.838380 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:13.839054 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:13.839525 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:13.839943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:13.899656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:13.907119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a9f2f3c6-8423-4183-9117-f8ed0299fbe7 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1614 microversion: 2.1 time: 0.081229 Sep 02 09:14:13.907679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 406/794] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:13 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1614 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:14.697654 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:14.698183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:14.705035 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:14.705516 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:14.705947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:14.706655 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:14.707127 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:14.707547 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:14.833541 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:14.841002 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b6616be-0196-4f7e-962e-374ca39ef0dd tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1691 microversion: 2.1 time: 0.147386 Sep 02 09:14:14.841563 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 389/795] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:14 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:14.929271 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:14.929981 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:14.936901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:14.937412 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:14.937872 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:14.938575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:14.939055 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:14.939507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:15.006941 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:15.014553 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ed68d2aa-0c98-49ba-99b9-7b2ed06f0fed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1614 microversion: 2.1 time: 0.090204 Sep 02 09:14:15.015129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 407/796] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:14 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:15.862525 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:15.863086 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:15.869330 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:15.869816 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:15.870251 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:15.870928 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:15.871400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:15.871842 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:16.002731 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:16.010266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bb00b299-3967-4fc5-953a-75c12fda97c2 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1691 microversion: 2.1 time: 0.152246 Sep 02 09:14:16.010827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 390/797] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:15 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:16.035991 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:16.036612 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:16.042976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:16.043489 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:16.043928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:16.044616 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:16.045070 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:16.045499 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:16.077293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:16.077293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:16.077293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:16.077671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lazy-loading 'fault' on Instance uuid 84250eef-a56f-4e60-bbdc-95143e398d49 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:14:16.130925 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:16.139162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-db27c61c-ddc5-4429-8f72-971778f2b8fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 200 len: 1331 microversion: 2.1 time: 0.107539 Sep 02 09:14:16.139727 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 408/798] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:16 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:16.927656 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-a34d645b-2a82-4366-a9c4-726545822190 req-8961ace5-ce50-4cad-a588-65db6eb2f2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a43d50-d1ca-449a-82ef-3df6b6fa88b8", "name": "network-vif-deleted", "tag": "91ef318d-54a2-4c8e-ab4c-a5d4963d60aa"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:16.941995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a34d645b-2a82-4366-a9c4-726545822190 req-8961ace5-ce50-4cad-a588-65db6eb2f2cd service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:16.942969 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a34d645b-2a82-4366-a9c4-726545822190 req-8961ace5-ce50-4cad-a588-65db6eb2f2cd service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:16.943533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a34d645b-2a82-4366-a9c4-726545822190 req-8961ace5-ce50-4cad-a588-65db6eb2f2cd service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:16.956545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-a34d645b-2a82-4366-a9c4-726545822190 req-8961ace5-ce50-4cad-a588-65db6eb2f2cd service nova] Creating event network-vif-deleted:91ef318d-54a2-4c8e-ab4c-a5d4963d60aa for instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 on hv-cinder-85535 Sep 02 09:14:16.962630 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-a34d645b-2a82-4366-a9c4-726545822190 req-8961ace5-ce50-4cad-a588-65db6eb2f2cd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040129 Sep 02 09:14:16.963420 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 391/799] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:17.031460 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:17.031935 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:17.053545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:17.054734 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:17.055674 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:17.056680 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:17.057009 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:17.057674 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:17.092379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:17.092838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:17.097596 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:17.098098 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lazy-loading 'fault' on Instance uuid 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:14:17.162076 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:17.162986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:17.174059 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:17.176006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:17.176147 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:17.176795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:17.178331 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:17.179150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:17.179780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:17.190566 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-20ded7c7-cf91-4167-8942-e63620254ea9 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 200 len: 1336 microversion: 2.1 time: 0.163055 Sep 02 09:14:17.192774 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 409/800] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:17 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 1336 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:17.195101 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 HTTP/1.1 Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:14:17.196917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:14:17.198475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '84250eef-a56f-4e60-bbdc-95143e398d49'} Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:14:17.199522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:14:17.200959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:17.202291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:14:17.202291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7d8a5592-1492-4080-b2c1-c17ee25a9216 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 404 len: 111 microversion: 2.1 time: 0.042902 Sep 02 09:14:17.203999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 392/801] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:17 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 09:14:17.210665 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c1ff1e8-dc33-4268-b155-6f7489c031ed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '.version_select at 0x7f54bc379c10>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:17.235713 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c1ff1e8-dc33-4268-b155-6f7489c031ed tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-663711302" status: 202 len: 0 microversion: 2.1 time: 0.028666 Sep 02 09:14:17.239914 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 410/802] 10.222.0.36 () {58 vars in 1218 bytes} [Fri Sep 2 09:14:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-663711302 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:14:18.129094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-96c935a8-f1b3-4b93-b42a-063bbe0700fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: .version_select at 0x7f54bc42dd30>, body: {"keypair": {"name": "tempest-keypair-1639960503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq/sZp4gP06RY8s82ipTm13KYg3btNj2f2JtdUzz0M1t0PV0cmW32Y1bpNKzJ6ly62Wheud33hvlME5zJgqUoPtC8wFq28goETKA1H8GObgSb2i1OJKA/3VEuUlInsAwg=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:18.147102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-96c935a8-f1b3-4b93-b42a-063bbe0700fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:14:18.150936 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-96c935a8-f1b3-4b93-b42a-063bbe0700fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for user e8b5ce2249a84c01ab57c03b656b2949 and project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:14:18.172339 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-96c935a8-f1b3-4b93-b42a-063bbe0700fc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047966 Sep 02 09:14:18.172961 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 393/803] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:14:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:18.211638 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:18.212243 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 57a43d50-d1ca-449a-82ef-3df6b6fa88b8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:18.218041 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:18.218526 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:18.218960 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:18.219671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:18.220162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:18.220609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:18.234966 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] HTTP exception thrown: Instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 could not be found. Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Request method failure captured: Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 HTTP/1.1 Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgc-uyj7G6dkesaoNotQXdG__Azb6l7pI9LJKFcZj1PxIrGFALWEzddAGu90ss9M-9iP9TCYmteOUjCJf4oYRyOi8Luhyj05cqciZdmQ8jCPqUJXj0HSPqyyQS2_cu0OrG6pklymGb8Aj6MPaar9pB3jV51Db9oha0q2YpmIr2Kv1M Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:14:18.237129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6fde620889f34b04bb7c9fcd5ad0a368", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: bf58157cbc8e49c5bd913c68ff859bfb Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 could not be found. Sep 02 09:14:18.238780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '57a43d50-d1ca-449a-82ef-3df6b6fa88b8'} Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 could not be found. Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:14:18.239806 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 could not be found. Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 could not be found. Sep 02 09:14:18.241071 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:14:18.242210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Returning 404 to user: Instance 57a43d50-d1ca-449a-82ef-3df6b6fa88b8 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:14:18.242210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-353c2a5a-5a7f-4453-833f-8fd7b5afc54c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8" status: 404 len: 111 microversion: 2.1 time: 0.031258 Sep 02 09:14:18.242210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 411/804] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:18 2022] GET /compute/v2.1/servers/57a43d50-d1ca-449a-82ef-3df6b6fa88b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:14:18.247966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-21dd4bf7-8d3f-407f-8434-1b8891a1f92f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '.version_select at 0x7f54bc2c63a0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:18.267698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-21dd4bf7-8d3f-407f-8434-1b8891a1f92f tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619577540" status: 202 len: 0 microversion: 2.1 time: 0.023567 Sep 02 09:14:18.268541 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 394/805] 10.222.0.36 () {58 vars in 1221 bytes} [Fri Sep 2 09:14:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619577540 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:14:19.457814 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-534163621", "imageRef": "4859e7b8-9db6-4680-bb0f-4a63f26d2f64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "426b5f66-dceb-4940-aa95-179f2d5137c7"}], "security_groups": [{"name": "tempest-securitygroup--1331444902"}], "key_name": "tempest-keypair-1639960503", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:19.558630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] validate_networks() for [('426b5f66-dceb-4940-aa95-179f2d5137c7', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:14:19.732976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:19.930278 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:14:19.930743 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:14:19.931269 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:14:19.931680 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:14:19.932091 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:14:19.941543 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:19.942020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:19.942451 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:19.943206 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:19.943662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:19.944085 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:19.960548 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:14:19.964423 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Getting quotas for user e8b5ce2249a84c01ab57c03b656b2949 and project 3450e9ca29fb44e4808fa52de2f88470. Resources: {'ram', 'instances', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:14:19.975699 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:14:19.977951 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4859e7b8-9db6-4680-bb0f-4a63f26d2f64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:14:19.995090 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:19.995742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:20.002977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:20.003568 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:20.004233 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:20.005180 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:20.005724 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:20.006297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:20.028697 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8e4e7690-ffd7-4f9c-8262-eb44946c597f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.576034 Sep 02 09:14:20.031137 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 412/806] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:14:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:14:20.040217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lazy-loading 'flavor' on Instance uuid d867d4df-9d60-4213-9895-3583d7914735 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:14:20.042748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-873e894d-dc0a-42fe-a715-cea263a41c91 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:20.043502 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-873e894d-dc0a-42fe-a715-cea263a41c91 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:20.109647 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-873e894d-dc0a-42fe-a715-cea263a41c91 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:20.122676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-873e894d-dc0a-42fe-a715-cea263a41c91 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1241 microversion: 2.1 time: 0.084338 Sep 02 09:14:20.123565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 413/807] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:20 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:20.146852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4c9db45b-e6b6-4195-832b-e36a618d3b83 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "POST /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735/action" status: 202 len: 0 microversion: 2.1 time: 0.156522 Sep 02 09:14:20.150779 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 395/808] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:14:19 2022] POST /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 09:14:20.156327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:20.157085 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:20.167493 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:20.168172 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:20.170529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:20.171584 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:20.172403 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:20.173097 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:20.325906 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:20.334573 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a4a7ac18-c98c-4fbb-81fb-2c22ea41f519 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.182563 Sep 02 09:14:20.335400 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 414/809] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:20 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:21.148630 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:21.149240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:21.155315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:21.155794 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:21.156224 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:21.156897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:21.157346 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:21.157760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:21.219594 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:21.222344 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:21.222842 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:21.227868 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ef60830e-2b95-4fb5-9ddc-c90516fd3587 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1293 microversion: 2.1 time: 0.083943 Sep 02 09:14:21.228432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 396/810] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:21 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:21.229104 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:21.229588 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:21.230027 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:21.230728 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:21.231222 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:21.231653 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:21.256020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:14:21.305850 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:21.334510 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6d918cee-0723-43cf-a50e-57646fc13e47 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "DELETE /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 204 len: 0 microversion: 2.1 time: 0.116200 Sep 02 09:14:21.335521 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 415/811] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:14:21 2022] DELETE /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 09:14:21.345399 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:21.346055 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:21.360884 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:21.361592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:21.361818 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:21.362328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:21.362770 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:21.363694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:21.364586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:21.365027 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:21.367796 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:21.368167 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:21.368630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:21.369296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:21.369757 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:21.370231 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:21.560105 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:21.564248 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:21.567720 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-33ded938-55f4-4e42-9914-b200e07ce98d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1508 microversion: 2.1 time: 0.226878 Sep 02 09:14:21.568297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 397/812] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:21 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:21.571914 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-931157fb-aef9-49c7-894b-c769df70d31a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.215307 Sep 02 09:14:21.572493 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 416/813] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:21 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:22.248614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:22.249226 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:22.256131 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:22.256614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:22.257111 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:22.257797 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:22.258251 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:22.258675 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:22.320514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:22.327962 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e7ffcae5-2c46-4cf9-b218-23a729f50bc4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1301 microversion: 2.1 time: 0.083214 Sep 02 09:14:22.328524 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 398/814] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:22 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1301 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:22.588434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:22.589009 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:22.591953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:22.592576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:22.595445 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:22.595934 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:22.596375 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:22.597073 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:22.597535 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:22.597966 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:22.598556 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:22.599033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:22.599493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:22.600173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:22.600622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:22.601039 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:22.788527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:22.792151 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:22.796453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9a947290-f47d-4303-99e7-dd8bec496340 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1508 microversion: 2.1 time: 0.211919 Sep 02 09:14:22.797031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 417/815] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:22 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:22.800398 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ca1ad35d-fd9d-4ffb-85a8-87dfbbcdf34e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.212360 Sep 02 09:14:22.800954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 399/816] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:22 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:14:23.349840 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:23.350416 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:23.356382 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:23.356872 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:23.357663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:23.357991 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:23.358451 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:23.358876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:23.429514 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:23.437358 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d3ee68af-398f-4e1c-aab9-bfe00e93f3bc tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1299 microversion: 2.1 time: 0.091989 Sep 02 09:14:23.438001 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 418/817] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:23 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:23.818521 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:23.819162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:23.821422 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:23.822522 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:23.826453 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:23.826945 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:23.827476 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:23.828188 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:23.828640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:23.829245 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:23.829619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:23.830130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:23.831430 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:23.832321 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:23.832801 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:23.833392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:24.182096 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:24.190354 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e06e22b0-3e4b-48c6-bd72-7e551576583c tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1508 microversion: 2.1 time: 0.376375 Sep 02 09:14:24.190931 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 400/818] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:23 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:24.197408 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:24.212155 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b15d7611-344b-4848-ad89-37a044992e02 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.394990 Sep 02 09:14:24.213333 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 419/819] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:23 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:24.459680 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:24.460442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:24.466573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:24.467415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:24.467955 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:24.468763 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:24.469488 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:24.470115 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:24.490794 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c04660c9-2af4-44f5-81b0-c310eb97eefc req-c477a325-1b7b-43a0-9adc-663aea21bb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21890f5d-be08-42c5-90ff-d0b7d69ac558", "name": "network-vif-deleted", "tag": "9c13a5b8-3d5b-4814-811e-bfc0c4e8f17b"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:24.508058 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c04660c9-2af4-44f5-81b0-c310eb97eefc req-c477a325-1b7b-43a0-9adc-663aea21bb41 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:24.509976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c04660c9-2af4-44f5-81b0-c310eb97eefc req-c477a325-1b7b-43a0-9adc-663aea21bb41 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:24.510579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c04660c9-2af4-44f5-81b0-c310eb97eefc req-c477a325-1b7b-43a0-9adc-663aea21bb41 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:24.526661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c04660c9-2af4-44f5-81b0-c310eb97eefc req-c477a325-1b7b-43a0-9adc-663aea21bb41 service nova] Creating event network-vif-deleted:9c13a5b8-3d5b-4814-811e-bfc0c4e8f17b for instance 21890f5d-be08-42c5-90ff-d0b7d69ac558 on hv-cinder-85535 Sep 02 09:14:24.532322 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c04660c9-2af4-44f5-81b0-c310eb97eefc req-c477a325-1b7b-43a0-9adc-663aea21bb41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047336 Sep 02 09:14:24.533489 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 420/820] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:24.756232 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:24.764447 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-61317323-56c6-438f-ac31-7652bb33f29b tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1367 microversion: 2.1 time: 0.310277 Sep 02 09:14:24.765141 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 401/821] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:24 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:25.212660 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:25.213364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:25.219508 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:25.219993 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:25.220436 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:25.221757 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:25.222262 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:25.222692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:25.234716 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:25.236038 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:25.243224 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:25.243929 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:25.244593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:25.245567 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:25.246183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:25.246784 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:25.257771 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:25.258561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:25.259006 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:25.259544 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lazy-loading 'fault' on Instance uuid 21890f5d-be08-42c5-90ff-d0b7d69ac558 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:14:25.339318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:25.348077 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aaa69633-3173-4de8-b251-b093ca38d42a tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 200 len: 1312 microversion: 2.1 time: 0.140120 Sep 02 09:14:25.348976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 421/822] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:25 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:25.496158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:25.504314 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-91feeacb-af4f-43c3-b158-b3b80c9fe8bc tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.274693 Sep 02 09:14:25.504973 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 402/823] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:25 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:14:25.785735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:25.786292 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:25.792098 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:25.792623 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:25.793050 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:25.793724 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:25.794172 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:25.794592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:25.921281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:25.929312 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4078d784-b1f7-45e5-b38f-96980d20d15d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1367 microversion: 2.1 time: 0.148207 Sep 02 09:14:25.929879 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 422/824] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:25 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:26.372828 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:26.373447 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 21890f5d-be08-42c5-90ff-d0b7d69ac558] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:26.380486 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.380970 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.381409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.382095 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.382559 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.382986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.396143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] HTTP exception thrown: Instance 21890f5d-be08-42c5-90ff-d0b7d69ac558 could not be found. Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Request method failure captured: Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 HTTP/1.1 Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgc-uyj7G6dkesaoNotQXdG__Azb6l7pI9LJKFcZj1PxIrGFALWEzddAGu90ss9M-9iP9TCYmteOUjCJf4oYRyOi8Luhyj05cqciZdmQ8jCPqUJXj0HSPqyyQS2_cu0OrG6pklymGb8Aj6MPaar9pB3jV51Db9oha0q2YpmIr2Kv1M Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:14:26.397764 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6fde620889f34b04bb7c9fcd5ad0a368", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: bf58157cbc8e49c5bd913c68ff859bfb Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 21890f5d-be08-42c5-90ff-d0b7d69ac558 could not be found. Sep 02 09:14:26.399283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '21890f5d-be08-42c5-90ff-d0b7d69ac558'} Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21890f5d-be08-42c5-90ff-d0b7d69ac558 could not be found. Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:14:26.400297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21890f5d-be08-42c5-90ff-d0b7d69ac558 could not be found. Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21890f5d-be08-42c5-90ff-d0b7d69ac558 could not be found. Sep 02 09:14:26.401864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:26.403261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Returning 404 to user: Instance 21890f5d-be08-42c5-90ff-d0b7d69ac558 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:14:26.403261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8887610d-9749-4252-b6ae-a9466c49995e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558" status: 404 len: 111 microversion: 2.1 time: 0.030129 Sep 02 09:14:26.403261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 403/825] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:26 2022] GET /compute/v2.1/servers/21890f5d-be08-42c5-90ff-d0b7d69ac558 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:14:26.407842 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:26.408457 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:26.414722 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.415231 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.415662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.416343 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.416792 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.417211 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.444098 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:14:26.516491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2411fe61-6849-4a28-ac32-94f297d87f16 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 204 len: 0 microversion: 2.1 time: 0.112226 Sep 02 09:14:26.517067 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 423/826] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:14:26 2022] DELETE /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:14:26.525089 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:26.525236 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:26.525698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:26.525926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:26.527669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:26.531999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.532486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.532719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.532915 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.533202 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.533659 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.533768 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.534109 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.534349 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.534531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.534837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.535297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.730199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:26.734591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:26.737995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b8074a9a-0f8c-4f8d-a3cf-563a25aeff7e tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.216657 Sep 02 09:14:26.738571 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 404/827] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:26 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:26.742936 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-70589916-5388-43b4-adf1-14aec3260fad req-a5cbaaf0-51a8-4085-a77f-da97ba1004db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05435fb1-da40-4636-b2f5-9b3ca2d38ce6", "tag": "6c37f539-6cdf-4d8f-b705-3b7fe9b80284"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:26.748616 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7e22068d-b92a-44a4-9ed4-51c73986cc96 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.227176 Sep 02 09:14:26.749438 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 424/828] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:26 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:26.752409 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-70589916-5388-43b4-adf1-14aec3260fad req-a5cbaaf0-51a8-4085-a77f-da97ba1004db service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.752994 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-70589916-5388-43b4-adf1-14aec3260fad req-a5cbaaf0-51a8-4085-a77f-da97ba1004db service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.753493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-70589916-5388-43b4-adf1-14aec3260fad req-a5cbaaf0-51a8-4085-a77f-da97ba1004db service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.764231 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-70589916-5388-43b4-adf1-14aec3260fad req-a5cbaaf0-51a8-4085-a77f-da97ba1004db service nova] Creating event network-changed:6c37f539-6cdf-4d8f-b705-3b7fe9b80284 for instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 on hv-cinder-85535 Sep 02 09:14:26.768999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-70589916-5388-43b4-adf1-14aec3260fad req-a5cbaaf0-51a8-4085-a77f-da97ba1004db service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029353 Sep 02 09:14:26.769562 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 405/829] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:26.949702 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:26.950242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:26.956380 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.956858 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.957286 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:26.957962 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:26.958415 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:26.958832 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:27.087745 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:27.095097 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-11682b91-7cff-46a0-932e-17a9194f1798 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1367 microversion: 2.1 time: 0.149255 Sep 02 09:14:27.095673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 425/830] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:26 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:27.759980 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:27.760687 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:27.766788 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:27.767257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:27.767694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:27.768392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:27.768845 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:27.769464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:27.770897 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:27.771553 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:27.777928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:27.778630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:27.779090 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:27.779798 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:27.780251 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:27.780668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:27.965247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:27.969920 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:27.973536 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d2b0cdf-429a-40e2-b686-c9103c28fa5d tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.218332 Sep 02 09:14:27.974113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 406/831] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:27 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:27.978517 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cc1d6dfe-6eb4-4731-adc3-3d30f6b8f012 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.212054 Sep 02 09:14:27.979142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 426/832] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:27 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:14:28.116419 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:28.117028 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:28.122755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:28.123268 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:28.123698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:28.124373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:28.124820 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:28.125238 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:28.131092 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:28.157700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:28.256671 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:28.264261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b50ba113-a725-4120-87ae-52033f2db1bf tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1367 microversion: 2.1 time: 0.151556 Sep 02 09:14:28.264828 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 407/833] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:28 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:28.994062 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:28.994631 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:28.999399 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:29.000008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:29.001015 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:29.001511 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:29.001947 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:29.003198 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:29.003659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:29.004080 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:29.006633 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:29.007142 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:29.007581 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:29.008275 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:29.008726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:29.009147 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:29.198375 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:29.202974 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:29.206953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c5978faa-4ee1-44ca-9061-e9c0b2370218 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.216781 Sep 02 09:14:29.207565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 427/834] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:28 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:29.211572 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f6ac6b08-6a97-48fb-a95f-9cafb67ce0a9 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.215846 Sep 02 09:14:29.212134 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 408/835] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:28 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:14:29.284547 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:29.285170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:29.291164 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:29.291650 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:29.292094 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:29.292774 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:29.293223 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:29.293646 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:29.502865 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:29.510449 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-89676338-ff08-45dc-8b3a-f32903f58d85 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1367 microversion: 2.1 time: 0.229727 Sep 02 09:14:29.510949 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 428/836] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:29 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:29.930695 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-9c267824-a36a-4c29-862d-c2d89448bfd3 req-5b450d35-977a-45e9-a636-1742f445fab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05435fb1-da40-4636-b2f5-9b3ca2d38ce6", "name": "network-vif-plugged", "status": "completed", "tag": "6c37f539-6cdf-4d8f-b705-3b7fe9b80284"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:29.941274 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9c267824-a36a-4c29-862d-c2d89448bfd3 req-5b450d35-977a-45e9-a636-1742f445fab1 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:29.941879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9c267824-a36a-4c29-862d-c2d89448bfd3 req-5b450d35-977a-45e9-a636-1742f445fab1 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:29.942412 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9c267824-a36a-4c29-862d-c2d89448bfd3 req-5b450d35-977a-45e9-a636-1742f445fab1 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:29.953638 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-9c267824-a36a-4c29-862d-c2d89448bfd3 req-5b450d35-977a-45e9-a636-1742f445fab1 service nova] Creating event network-vif-plugged:6c37f539-6cdf-4d8f-b705-3b7fe9b80284 for instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 on hv-cinder-85535 Sep 02 09:14:29.958866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-9c267824-a36a-4c29-862d-c2d89448bfd3 req-5b450d35-977a-45e9-a636-1742f445fab1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098574 Sep 02 09:14:29.959591 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 409/837] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:30.229842 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:30.235427 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:30.236159 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:30.237992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:30.240268 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:30.240953 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=8 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:30.246641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:30.247156 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:30.247615 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:30.250641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:30.251306 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:30.251864 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:30.254390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:30.254950 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:30.255638 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:30.257681 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:30.257681 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:30.257681 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:30.565947 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:30.569552 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:30.573629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-979b2aed-ae1e-409d-aaa7-6f52de210913 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1522 microversion: 2.1 time: 0.349794 Sep 02 09:14:30.574203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 429/838] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:30 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:30.577284 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-83a05576-8358-4307-93e8-cb9bd6371771 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.348035 Sep 02 09:14:30.577833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 410/839] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:30 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:30.578914 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:30.579804 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:30.583572 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-8f85644b-a001-457d-8270-5e8dbc13a0f8 req-0d390087-5b2c-4092-8995-1de52872f13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d56b84b-6132-4d68-8ead-b4a14070a060", "name": "network-vif-deleted", "tag": "6063817b-61b3-404e-b9c1-6afc180fee12"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:30.585485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:30.585978 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:30.586416 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:30.587119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:30.587577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:30.588000 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:30.593669 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8f85644b-a001-457d-8270-5e8dbc13a0f8 req-0d390087-5b2c-4092-8995-1de52872f13d service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:30.594141 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8f85644b-a001-457d-8270-5e8dbc13a0f8 req-0d390087-5b2c-4092-8995-1de52872f13d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:30.594563 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8f85644b-a001-457d-8270-5e8dbc13a0f8 req-0d390087-5b2c-4092-8995-1de52872f13d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:30.606222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-8f85644b-a001-457d-8270-5e8dbc13a0f8 req-0d390087-5b2c-4092-8995-1de52872f13d service nova] Creating event network-vif-deleted:6063817b-61b3-404e-b9c1-6afc180fee12 for instance 5d56b84b-6132-4d68-8ead-b4a14070a060 on hv-cinder-85535 Sep 02 09:14:30.612790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-8f85644b-a001-457d-8270-5e8dbc13a0f8 req-0d390087-5b2c-4092-8995-1de52872f13d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032881 Sep 02 09:14:30.613553 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 411/840] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:30.717557 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:30.725745 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f3b2a465-8259-4272-9cc2-168ff7270e1f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1367 microversion: 2.1 time: 0.150566 Sep 02 09:14:30.726352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 430/841] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:30 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:31.597252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:31.598321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:31.603646 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:31.605228 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:31.605541 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:31.606246 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:31.606768 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:31.607672 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:31.608282 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:31.609452 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:31.614811 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:31.615357 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:31.615980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:31.616839 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:31.617294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:31.617711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:31.621930 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:31.643485 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:31.644045 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:31.644643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:31.645100 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lazy-loading 'fault' on Instance uuid 5d56b84b-6132-4d68-8ead-b4a14070a060 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:14:31.707425 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf58157cbc8e49c5bd913c68ff859bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fde620889f34b04bb7c9fcd5ad0a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:31.714921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e00f3f41-ab8b-421f-9321-f10071a4233b tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 200 len: 1312 microversion: 2.1 time: 0.124045 Sep 02 09:14:31.715525 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 412/842] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:31 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:31.745634 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:31.746248 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:31.752061 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:31.752616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:31.753066 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:31.753744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:31.754197 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:31.754622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:31.774203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:31.781919 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e20cce03-9679-4c34-a9af-6f3b4ba961c3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.184958 Sep 02 09:14:31.782578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 431/843] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:31 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:31.884824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:31.892412 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e44a986c-1f86-4bfb-9cad-162aa915a70e tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1558 microversion: 2.1 time: 0.150539 Sep 02 09:14:31.893478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 413/844] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:31 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:14:31.913788 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7bbcf839-55ca-4f22-b8e4-da7c8edfce1c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:31.914296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7bbcf839-55ca-4f22-b8e4-da7c8edfce1c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:31.920511 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bbcf839-55ca-4f22-b8e4-da7c8edfce1c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:31.920995 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bbcf839-55ca-4f22-b8e4-da7c8edfce1c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:31.921434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bbcf839-55ca-4f22-b8e4-da7c8edfce1c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:31.922130 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bbcf839-55ca-4f22-b8e4-da7c8edfce1c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:31.922588 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bbcf839-55ca-4f22-b8e4-da7c8edfce1c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:31.923012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bbcf839-55ca-4f22-b8e4-da7c8edfce1c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:32.001291 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7bbcf839-55ca-4f22-b8e4-da7c8edfce1c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091388 Sep 02 09:14:32.001896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 432/845] 10.222.0.36 () {58 vars in 1275 bytes} [Fri Sep 2 09:14:31 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:32.737534 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:32.738156 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] [instance: 5d56b84b-6132-4d68-8ead-b4a14070a060] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:32.744498 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:32.745000 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:32.745438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:32.746135 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:32.746596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:32.747018 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:32.760247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] HTTP exception thrown: Instance 5d56b84b-6132-4d68-8ead-b4a14070a060 could not be found. Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Request method failure captured: Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 HTTP/1.1 Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgc-uyj7G6dkesaoNotQXdG__Azb6l7pI9LJKFcZj1PxIrGFALWEzddAGu90ss9M-9iP9TCYmteOUjCJf4oYRyOi8Luhyj05cqciZdmQ8jCPqUJXj0HSPqyyQS2_cu0OrG6pklymGb8Aj6MPaar9pB3jV51Db9oha0q2YpmIr2Kv1M Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:14:32.761880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6fde620889f34b04bb7c9fcd5ad0a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6fde620889f34b04bb7c9fcd5ad0a368", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 6fde620889f34b04bb7c9fcd5ad0a368 Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121495316 Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: bf58157cbc8e49c5bd913c68ff859bfb Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121495316-project Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 5d56b84b-6132-4d68-8ead-b4a14070a060 could not be found. Sep 02 09:14:32.763469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '5d56b84b-6132-4d68-8ead-b4a14070a060'} Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d56b84b-6132-4d68-8ead-b4a14070a060 could not be found. Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:14:32.764373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d56b84b-6132-4d68-8ead-b4a14070a060 could not be found. Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d56b84b-6132-4d68-8ead-b4a14070a060 could not be found. Sep 02 09:14:32.765862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:14:32.767189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] Returning 404 to user: Instance 5d56b84b-6132-4d68-8ead-b4a14070a060 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:14:32.767189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c2858587-264c-4f4d-bb6b-c9dbf99b8e37 tempest-ServerRescueNegativeTestJSON-2121495316 tempest-ServerRescueNegativeTestJSON-2121495316-project] 10.222.0.36 "GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060" status: 404 len: 111 microversion: 2.1 time: 0.031130 Sep 02 09:14:32.767189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 414/846] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:32 2022] GET /compute/v2.1/servers/5d56b84b-6132-4d68-8ead-b4a14070a060 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:14:32.803941 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:32.804568 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:32.811439 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:32.811954 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:32.812389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:32.813078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:32.813654 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:32.814084 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:33.083616 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:33.092129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dbbcda21-101b-4f69-81df-741f774df78c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.292087 Sep 02 09:14:33.092713 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 433/847] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:32 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:33.569044 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-cd59692e-543d-4f88-a0b6-0deb1f6e88b2 req-b92656e7-9fa9-4063-8ffb-fa7a5ede674a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05435fb1-da40-4636-b2f5-9b3ca2d38ce6", "tag": "6c37f539-6cdf-4d8f-b705-3b7fe9b80284"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:33.578230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cd59692e-543d-4f88-a0b6-0deb1f6e88b2 req-b92656e7-9fa9-4063-8ffb-fa7a5ede674a service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:33.578709 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cd59692e-543d-4f88-a0b6-0deb1f6e88b2 req-b92656e7-9fa9-4063-8ffb-fa7a5ede674a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:33.579168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cd59692e-543d-4f88-a0b6-0deb1f6e88b2 req-b92656e7-9fa9-4063-8ffb-fa7a5ede674a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:33.592558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-cd59692e-543d-4f88-a0b6-0deb1f6e88b2 req-b92656e7-9fa9-4063-8ffb-fa7a5ede674a service nova] Creating event network-changed:6c37f539-6cdf-4d8f-b705-3b7fe9b80284 for instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 on hv-cinder-85535 Sep 02 09:14:33.597597 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-cd59692e-543d-4f88-a0b6-0deb1f6e88b2 req-b92656e7-9fa9-4063-8ffb-fa7a5ede674a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032695 Sep 02 09:14:33.598844 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 415/848] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:34.114900 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:34.116163 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:34.124863 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:34.125586 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:34.126178 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:34.127087 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:34.128270 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:34.128855 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:34.284426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:34.292275 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-df022add-acd8-447b-825f-8defee0e6cd1 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.182431 Sep 02 09:14:34.292998 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 434/849] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:34 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:35.316153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:35.317043 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:35.324386 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:35.326156 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:35.327825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:35.329008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:35.330546 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:35.331817 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:35.564660 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:35.569072 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-79a1e8a1-66b6-4d23-b276-d80bf681786b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1567 microversion: 2.1 time: 0.258963 Sep 02 09:14:35.569652 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 416/850] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:35 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:35.589974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:35.590577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:35.597673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:35.598162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:35.598608 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:35.599412 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:35.600067 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:35.601298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:35.633722 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120573) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 09:14:35.709389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-225df706-3a7e-46ef-b332-fec1e9cfff1a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "POST /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735/action" status: 202 len: 0 microversion: 2.1 time: 0.123423 Sep 02 09:14:35.710316 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 435/851] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:14:35 2022] POST /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:14:35.718472 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:35.719384 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:35.729735 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:35.730240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:35.730774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:35.731927 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:35.732316 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:35.732904 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:35.904260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:35.915245 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-89283135-64c6-45fa-8efb-c4c52e57a581 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1575 microversion: 2.1 time: 0.200577 Sep 02 09:14:35.915952 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 417/852] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:35 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1575 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:14:36.936113 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:36.937341 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:36.943558 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:36.943909 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:36.944232 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:36.945119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:36.945603 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:36.945990 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:37.115348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:37.123820 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c858a20e-0b14-443f-bd82-9b0869b99ca0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1517 microversion: 2.1 time: 0.192013 Sep 02 09:14:37.126535 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 436/853] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:36 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1517 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:37.859506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-ffd29df5-059a-4334-b65e-0023ef31505f req-6721e3f4-8291-444a-a9f4-4c7b2bba186a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d867d4df-9d60-4213-9895-3583d7914735", "name": "network-vif-unplugged", "status": "completed", "tag": "f8ab8844-1efe-4e80-a575-5c63bfe8bdda"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:37.869933 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ffd29df5-059a-4334-b65e-0023ef31505f req-6721e3f4-8291-444a-a9f4-4c7b2bba186a service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:37.870599 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ffd29df5-059a-4334-b65e-0023ef31505f req-6721e3f4-8291-444a-a9f4-4c7b2bba186a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:37.871291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ffd29df5-059a-4334-b65e-0023ef31505f req-6721e3f4-8291-444a-a9f4-4c7b2bba186a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:37.886423 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-ffd29df5-059a-4334-b65e-0023ef31505f req-6721e3f4-8291-444a-a9f4-4c7b2bba186a service nova] Creating event network-vif-unplugged:f8ab8844-1efe-4e80-a575-5c63bfe8bdda for instance d867d4df-9d60-4213-9895-3583d7914735 on hv-cinder-85535 Sep 02 09:14:37.891823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-ffd29df5-059a-4334-b65e-0023ef31505f req-6721e3f4-8291-444a-a9f4-4c7b2bba186a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036366 Sep 02 09:14:37.892425 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 418/854] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:38.146127 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:38.146746 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:38.153049 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:38.153577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:38.154200 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:38.154903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:38.155421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:38.155985 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:38.375216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:38.386190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-844ea3ff-b54e-4b3f-9370-c114af8cd2b0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.244281 Sep 02 09:14:38.386780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 437/855] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:38 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:39.409345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:39.410771 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:39.417161 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:39.417734 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:39.418180 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:39.418949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:39.419438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:39.419882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:39.562660 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:39.570432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ca35971f-f062-4035-a218-dfd223a39f4e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.166278 Sep 02 09:14:39.570995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 419/856] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:39 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:40.591391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:40.592032 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:40.598542 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:40.599035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:40.599501 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:40.600199 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:40.600654 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:40.601080 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:40.736106 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:40.744859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e84ae7e7-c8b0-4b23-9c12-90024945cb85 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.157365 Sep 02 09:14:40.745434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 438/857] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:40 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:41.766713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:41.767304 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:41.774225 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:41.774709 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:41.775176 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:41.775896 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:41.776348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:41.776771 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:41.903303 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:41.911128 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-24bb99c3-17ee-4c4c-92c8-422427674c64 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.148244 Sep 02 09:14:41.911699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 420/858] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:41 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:42.931819 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:42.932437 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:42.938692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:42.939216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:42.940231 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:42.940902 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:42.941426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:42.941857 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:43.073123 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:43.080979 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e93c43be-2ec1-4173-b66e-356a894860c0 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.153055 Sep 02 09:14:43.081540 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 439/859] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:42 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:43.809965 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b6faa539-d9f6-4979-b75e-c5baae82a98f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:43.810515 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b6faa539-d9f6-4979-b75e-c5baae82a98f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:43.816813 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6faa539-d9f6-4979-b75e-c5baae82a98f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:43.817293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6faa539-d9f6-4979-b75e-c5baae82a98f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:43.817722 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6faa539-d9f6-4979-b75e-c5baae82a98f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:43.818397 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6faa539-d9f6-4979-b75e-c5baae82a98f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:43.818847 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6faa539-d9f6-4979-b75e-c5baae82a98f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:43.819294 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6faa539-d9f6-4979-b75e-c5baae82a98f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:43.841961 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b6faa539-d9f6-4979-b75e-c5baae82a98f tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/ips" status: 200 len: 150 microversion: 2.20 time: 0.035926 Sep 02 09:14:43.842497 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 421/860] 10.222.0.36 () {60 vars in 1289 bytes} [Fri Sep 2 09:14:43 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:14:44.104044 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:44.104760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:44.115802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:44.115802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:44.115802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:44.115802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:44.116735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:44.116735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:44.253545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:44.262322 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-32ca28cb-a908-4a5f-9d49-13f25dc18a5e tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.162132 Sep 02 09:14:44.263292 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 440/861] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:44 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:45.285153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:45.286412 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:45.293143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:45.293738 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:45.294139 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:45.294915 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:45.295391 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:45.295823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:45.448364 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:45.456293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-51ddce4e-899f-4c82-9ee9-24cec3980e2b tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.175941 Sep 02 09:14:45.456867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 422/862] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:45 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:45.955149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:45.955149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:45.961723 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:45.962205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:45.962635 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:45.963356 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:45.963805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:45.964262 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:45.987102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lazy-loading 'flavor' on Instance uuid dde844d8-53ed-4ac1-813f-80203a754084 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:14:46.165524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fba174b6-234f-4e5e-afe2-7428028d4b02 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/action" status: 202 len: 0 microversion: 2.20 time: 0.215338 Sep 02 09:14:46.166127 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 441/863] 10.222.0.36 () {62 vars in 1319 bytes} [Fri Sep 2 09:14:45 2022] POST /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:14:46.174854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:46.175643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:46.182516 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:46.183105 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:46.184082 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:46.185082 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:46.185910 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:46.186432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:46.326285 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:46.335726 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:46.337165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:46.338376 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3d563219-b311-4829-897c-dfa1db43305e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.167928 Sep 02 09:14:46.338930 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 423/864] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:46 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:46.477421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:46.478128 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:46.484295 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:46.484778 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:46.485208 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:46.485895 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:46.486342 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:46.486797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:46.632716 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:46.640439 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-06cbdd26-9536-45a4-a4df-fdfbb0174ec4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.167107 Sep 02 09:14:46.641166 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 442/865] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:46 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:47.362973 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:47.363613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:47.369979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:47.370458 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:47.370886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:47.371605 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:47.372062 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:47.372487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:47.507337 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:47.515533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:47.516982 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:47.518167 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6b02cdd5-e71e-4881-90ff-c30da446f0e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.159859 Sep 02 09:14:47.518716 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 424/866] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:47 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:47.661054 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:47.661641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:47.667992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:47.668467 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:47.668889 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:47.669567 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:47.670015 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:47.670430 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:47.801982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:47.809543 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1d1b0754-29ac-4732-aa26-e6a3096c29c4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.152369 Sep 02 09:14:47.810117 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 443/867] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:47 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:48.541151 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:48.541734 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:48.548043 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:48.548536 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:48.548978 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:48.549675 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:48.550135 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:48.550564 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:48.682542 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:48.691433 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:48.692873 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:48.694023 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-72cdd0c9-5621-4964-998e-30b5c066b1d5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.156856 Sep 02 09:14:48.694616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 425/868] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:48 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:48.831012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:48.831775 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:48.835590 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:48.839656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:48.840131 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:48.840586 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:48.841367 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:48.841820 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:48.842233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:48.979748 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:48.988286 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-75e65d85-c1d2-48e7-bc47-f2b4c19b2a57 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.162520 Sep 02 09:14:48.988856 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 444/869] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:48 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:49.717282 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:49.717889 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:49.724902 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:49.725382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:49.725815 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:49.726500 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:49.726951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:49.727403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:49.856960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:49.864929 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:49.866369 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:49.867547 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b8356871-e883-4eb7-b2a9-0446780e0c11 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.154158 Sep 02 09:14:49.868107 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 426/870] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:49 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:50.009677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:50.010215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:50.016451 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:50.016923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:50.017350 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:50.018651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:50.019159 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:50.019580 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:50.023385 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:50.147256 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:50.154798 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-17360bdc-0e70-4840-989c-aa07890cae74 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.148965 Sep 02 09:14:50.155398 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 445/871] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:50 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:50.889637 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:50.890252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:50.897230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:50.897713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:50.898150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:50.898838 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:50.899318 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:50.899746 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:50.903656 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:51.025856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:51.033770 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:51.035287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:51.036432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-122946c3-42c9-406f-9a71-9a593f3e687e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.150645 Sep 02 09:14:51.036991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 427/872] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:50 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:51.175144 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:51.175753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:51.182162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:51.182639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:51.183095 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:51.183836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:51.184284 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:51.184705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:51.319680 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:51.327321 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8581e7d5-0e55-479c-9b35-ad5da9ae44de tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.156486 Sep 02 09:14:51.327889 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 446/873] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:51 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:51.906117 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-ea6a6985-9c60-42fa-b975-bc60a5ed16ed req-aeebc5f6-0804-4a33-8587-5eff36ca9e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d867d4df-9d60-4213-9895-3583d7914735", "name": "network-vif-plugged", "status": "completed", "tag": "f8ab8844-1efe-4e80-a575-5c63bfe8bdda"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:51.917581 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ea6a6985-9c60-42fa-b975-bc60a5ed16ed req-aeebc5f6-0804-4a33-8587-5eff36ca9e7c service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:51.918432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ea6a6985-9c60-42fa-b975-bc60a5ed16ed req-aeebc5f6-0804-4a33-8587-5eff36ca9e7c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:51.918863 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ea6a6985-9c60-42fa-b975-bc60a5ed16ed req-aeebc5f6-0804-4a33-8587-5eff36ca9e7c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:51.930558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-ea6a6985-9c60-42fa-b975-bc60a5ed16ed req-aeebc5f6-0804-4a33-8587-5eff36ca9e7c service nova] Creating event network-vif-plugged:f8ab8844-1efe-4e80-a575-5c63bfe8bdda for instance d867d4df-9d60-4213-9895-3583d7914735 on hv-cinder-85535 Sep 02 09:14:51.935463 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-ea6a6985-9c60-42fa-b975-bc60a5ed16ed req-aeebc5f6-0804-4a33-8587-5eff36ca9e7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033220 Sep 02 09:14:51.936134 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 428/874] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:52.058675 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:52.059236 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:52.065166 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:52.065657 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:52.066670 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:52.067379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:52.067834 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:52.068252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:52.223373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:52.231688 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:52.233138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:52.234298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6e4da7a0-af2c-4fbf-8f3c-926179246f1d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.179585 Sep 02 09:14:52.234862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 447/875] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:52 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:52.349181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:52.349907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:52.356632 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:52.357122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:52.357558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:52.358260 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:52.358709 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:52.359154 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:52.641811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:52.650143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-66305e8d-79c3-42fb-bf79-9cb9721828b4 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.305246 Sep 02 09:14:52.650717 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 429/876] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:52 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:53.257545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:53.258148 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:53.264469 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:53.264946 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:53.265377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:53.266059 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:53.266511 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:53.266929 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:53.298183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3e9935b0-8b3b-4761-9cc3-5d9268e89dd7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:53.298742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3e9935b0-8b3b-4761-9cc3-5d9268e89dd7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:53.305873 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e9935b0-8b3b-4761-9cc3-5d9268e89dd7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:53.306437 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e9935b0-8b3b-4761-9cc3-5d9268e89dd7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:53.306879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e9935b0-8b3b-4761-9cc3-5d9268e89dd7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:53.307596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e9935b0-8b3b-4761-9cc3-5d9268e89dd7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:53.308050 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e9935b0-8b3b-4761-9cc3-5d9268e89dd7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:53.308472 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e9935b0-8b3b-4761-9cc3-5d9268e89dd7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:53.333454 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3e9935b0-8b3b-4761-9cc3-5d9268e89dd7 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/ips" status: 200 len: 145 microversion: 2.1 time: 0.039038 Sep 02 09:14:53.334031 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 430/877] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:14:53 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:14:53.403293 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:53.412677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:53.414781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:53.416046 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2194b9f3-611e-4c42-8ed9-b1addcdb2a52 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.162513 Sep 02 09:14:53.416701 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 448/878] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:53 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:53.671666 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:53.672273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:53.678654 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:53.679166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:53.679602 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:53.680276 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:53.680741 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:53.681145 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:53.812464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:53.820424 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8f47a686-6938-4107-b7b0-bca1668b3d89 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.152872 Sep 02 09:14:53.820981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 431/879] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:53 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:54.437799 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:54.438412 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:54.445421 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:54.445904 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:54.446343 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:54.447035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:54.447545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:54.447974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:54.572590 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:54.581051 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:54.582481 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:54.583706 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-76de05f9-87ab-4d95-9de3-8d26a0a62738 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.149802 Sep 02 09:14:54.584270 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 449/880] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:54 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:54.843723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:54.843723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:54.848373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:54.848851 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:54.849282 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:54.850017 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:54.850466 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:54.850883 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:54.979957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:54.987898 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-73074696-1982-4d01-af43-87a9ecf06129 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.150169 Sep 02 09:14:54.988460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 432/881] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:54 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:55.606728 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:55.607371 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:55.614316 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:55.614793 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:55.615256 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:55.615935 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:55.616386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:55.616931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:55.745680 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:55.754501 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:55.755977 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:55.757141 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7472f7c1-93c7-431b-9ee2-141af67ce872 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.154280 Sep 02 09:14:55.757716 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 450/882] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:55 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:56.008886 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:56.009503 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:56.016122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:56.016614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:56.017053 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:56.018442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:56.018910 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:56.019381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:56.152382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:56.160662 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-68984b1b-e8d8-4e84-977f-7e098e9b5c5c tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1573 microversion: 2.1 time: 0.155598 Sep 02 09:14:56.161229 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 433/883] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:56 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:14:56.758591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-977a2919-951f-4fd7-8ff3-6c4f359e1683 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1e08c9e-3361-4fa0-8147-5e16aec2b236"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:14:56.760984 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-977a2919-951f-4fd7-8ff3-6c4f359e1683 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:56.767375 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977a2919-951f-4fd7-8ff3-6c4f359e1683 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:56.767856 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977a2919-951f-4fd7-8ff3-6c4f359e1683 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:56.768290 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977a2919-951f-4fd7-8ff3-6c4f359e1683 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:56.768980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977a2919-951f-4fd7-8ff3-6c4f359e1683 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:56.769503 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977a2919-951f-4fd7-8ff3-6c4f359e1683 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:56.769931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977a2919-951f-4fd7-8ff3-6c4f359e1683 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:56.779459 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:56.780263 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:56.782534 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=62 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:14:56.789712 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:56.790204 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:56.790640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:56.791381 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:56.791832 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:56.792253 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:56.965431 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:56.975558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:56.976979 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:56.978217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c7f8013f-a465-4cd9-a858-5a43959915b7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.202732 Sep 02 09:14:56.978780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 434/884] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:56 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:57.181472 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:57.182177 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:57.189116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:57.189645 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:57.190142 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:57.190825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:57.191302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:57.191723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:57.215103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-977a2919-951f-4fd7-8ff3-6c4f359e1683 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459908 Sep 02 09:14:57.216133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 451/885] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:14:56 2022] POST /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:14:57.348861 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:57.357393 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-12e82526-2d95-4747-83da-b41844f803ed tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1560 microversion: 2.1 time: 0.179244 Sep 02 09:14:57.357546 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 435/886] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:14:57 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:14:58.001305 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:58.001994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:58.008570 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:58.009051 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:58.009483 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:58.010166 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:58.010612 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:58.011029 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:58.142423 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:58.150860 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:58.152334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:58.153484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eedea9e3-9f1e-48ed-9001-9b68f3b769ce tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.156487 Sep 02 09:14:58.167141 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 452/887] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:57 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:14:59.177736 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:14:59.178345 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:14:59.184860 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:59.185356 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:59.185785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:59.186475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:14:59.186929 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:14:59.187386 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:14:59.312783 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:59.321289 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:59.322727 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:14:59.323901 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d0d25495-0d05-4209-b517-e9e6c9b659df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.150303 Sep 02 09:14:59.324455 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 436/888] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:14:59 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:00.349066 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:00.349679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:00.356091 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:00.356578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:00.357016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:00.357744 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:00.358210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:00.358633 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:00.492282 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:00.500286 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:00.501727 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:00.502893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-27ca4a44-dd20-407b-af5c-b5febfcabee9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.157743 Sep 02 09:15:00.503478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 453/889] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:00 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:01.525051 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:01.525693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:01.532140 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:01.532626 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:01.533064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:01.533746 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:01.534198 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:01.534621 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:01.662608 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:01.670694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:01.672158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:01.673301 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b95e814-0422-46a7-84e6-4002a9a5480d tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.152127 Sep 02 09:15:01.674350 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 437/890] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:01 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:02.696894 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:02.697504 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:02.703916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:02.704395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:02.704826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:02.706043 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:02.706497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:02.706921 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:02.845600 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:02.853661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:02.855162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:02.856378 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-781659b8-10bf-463a-bc64-3b6771869fd8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1744 microversion: 2.20 time: 0.163639 Sep 02 09:15:02.856923 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 454/891] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:02 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:03.882462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:03.888825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:03.896091 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:03.896646 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:03.897337 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:03.898254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:03.898733 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:03.899305 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:04.177132 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:04.185003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:04.186439 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:04.187616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a78cee50-32f0-4444-989a-b5042dd601b6 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1744 microversion: 2.20 time: 0.312142 Sep 02 09:15:04.188169 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 438/892] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:03 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1744 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:04.745743 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c422e900-0125-4fec-a8c5-da1f3c85469f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:04.748014 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c422e900-0125-4fec-a8c5-da1f3c85469f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:04.754375 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c422e900-0125-4fec-a8c5-da1f3c85469f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:04.754865 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c422e900-0125-4fec-a8c5-da1f3c85469f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:04.755345 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c422e900-0125-4fec-a8c5-da1f3c85469f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:04.756038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c422e900-0125-4fec-a8c5-da1f3c85469f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:04.756498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c422e900-0125-4fec-a8c5-da1f3c85469f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:04.756928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c422e900-0125-4fec-a8c5-da1f3c85469f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:04.786612 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c422e900-0125-4fec-a8c5-da1f3c85469f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Sep 02 09:15:04.787179 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 455/893] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:15:04 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:15:04.797578 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-38602ba4-6b31-4a1d-8ab2-711a213dcdff tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:04.798067 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-38602ba4-6b31-4a1d-8ab2-711a213dcdff tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:04.803819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38602ba4-6b31-4a1d-8ab2-711a213dcdff tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:04.804336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38602ba4-6b31-4a1d-8ab2-711a213dcdff tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:04.804768 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38602ba4-6b31-4a1d-8ab2-711a213dcdff tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:04.805450 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38602ba4-6b31-4a1d-8ab2-711a213dcdff tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:04.805902 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38602ba4-6b31-4a1d-8ab2-711a213dcdff tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:04.806322 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38602ba4-6b31-4a1d-8ab2-711a213dcdff tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:04.835298 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-38602ba4-6b31-4a1d-8ab2-711a213dcdff tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/d1e08c9e-3361-4fa0-8147-5e16aec2b236" status: 200 len: 194 microversion: 2.1 time: 0.041554 Sep 02 09:15:04.835884 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 439/894] 10.222.0.36 () {58 vars in 1413 bytes} [Fri Sep 2 09:15:04 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/d1e08c9e-3361-4fa0-8147-5e16aec2b236 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:15:05.210526 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:05.211096 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:05.216881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:05.217361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:05.217803 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:05.218488 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:05.218945 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:05.219401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:05.353464 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:05.361971 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:05.363422 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:05.364568 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ff729926-faa2-451a-ae3c-d1e0f3660b61 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1744 microversion: 2.20 time: 0.158009 Sep 02 09:15:05.365104 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 456/895] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:05 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:06.387947 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:06.388555 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:06.395488 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:06.395971 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:06.396406 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:06.397105 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:06.397547 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:06.398003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:06.528565 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:06.536415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:06.537841 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:06.538978 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c04dc24a-5814-4927-aa25-7d541ef376f3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1744 microversion: 2.20 time: 0.154902 Sep 02 09:15:06.539552 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 440/896] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:06 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:07.561532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:07.562146 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:07.568516 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:07.569042 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:07.569484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:07.570177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:07.570634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:07.571058 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:07.702533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:07.711544 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:07.713223 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:07.714367 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ed5596ba-49a4-4b07-bf49-57ca75c5b399 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1744 microversion: 2.20 time: 0.156751 Sep 02 09:15:07.714918 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 457/897] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:07 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:08.266913 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bafa1003-612e-4d87-8852-1f74b03018e8 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87b1c902-dfa0-427d-9f05-109ccc29dc50"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:15:08.270911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bafa1003-612e-4d87-8852-1f74b03018e8 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:08.276967 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bafa1003-612e-4d87-8852-1f74b03018e8 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:08.277459 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bafa1003-612e-4d87-8852-1f74b03018e8 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:08.277900 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bafa1003-612e-4d87-8852-1f74b03018e8 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:08.278751 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bafa1003-612e-4d87-8852-1f74b03018e8 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:08.279632 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bafa1003-612e-4d87-8852-1f74b03018e8 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:08.280222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bafa1003-612e-4d87-8852-1f74b03018e8 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:08.600891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bafa1003-612e-4d87-8852-1f74b03018e8 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "POST /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337397 Sep 02 09:15:08.602545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 441/898] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:15:08 2022] POST /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:15:08.738690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:08.740001 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:08.752545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:08.753334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:08.753865 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:08.754671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:08.755384 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:08.755861 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:08.912404 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:08.920910 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:08.922650 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:08.923910 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ff4cc72c-ba1b-40c8-81b3-36a77d2e7967 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1739 microversion: 2.20 time: 0.189989 Sep 02 09:15:08.924459 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 458/899] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:08 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:09.948662 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:09.949372 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:09.959534 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:09.960034 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:09.960475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:09.966948 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-94cb98c5-dd93-4e56-a9b1-3002c2f2594d req-9f193a35-9487-4cc7-9b7c-617fd93da208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde844d8-53ed-4ac1-813f-80203a754084", "name": "network-vif-plugged", "status": "completed", "tag": "d6bad915-ef87-444d-aa2b-102e8e9b311d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:15:09.970593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:09.971888 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:09.972352 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:09.983600 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-94cb98c5-dd93-4e56-a9b1-3002c2f2594d req-9f193a35-9487-4cc7-9b7c-617fd93da208 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:09.984452 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-94cb98c5-dd93-4e56-a9b1-3002c2f2594d req-9f193a35-9487-4cc7-9b7c-617fd93da208 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:09.985159 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-94cb98c5-dd93-4e56-a9b1-3002c2f2594d req-9f193a35-9487-4cc7-9b7c-617fd93da208 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:09.998841 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-94cb98c5-dd93-4e56-a9b1-3002c2f2594d req-9f193a35-9487-4cc7-9b7c-617fd93da208 service nova] Creating event network-vif-plugged:d6bad915-ef87-444d-aa2b-102e8e9b311d for instance dde844d8-53ed-4ac1-813f-80203a754084 on hv-cinder-85535 Sep 02 09:15:10.005251 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-94cb98c5-dd93-4e56-a9b1-3002c2f2594d req-9f193a35-9487-4cc7-9b7c-617fd93da208 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042470 Sep 02 09:15:10.006503 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 459/900] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:15:10.143981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:10.152490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:10.154321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:10.155094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-69a4c4eb-af89-4fb6-9c30-4a8281868a74 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1739 microversion: 2.20 time: 0.210769 Sep 02 09:15:10.155834 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 442/901] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:09 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:11.182353 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:11.183752 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:11.190568 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:11.191297 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:11.191957 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:11.192875 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:11.193330 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:11.193907 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:11.342061 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:11.355103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:11.356994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:11.358230 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6ce037b9-64f5-463e-b7df-1e3d9edd7599 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1739 microversion: 2.20 time: 0.182284 Sep 02 09:15:11.375547 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 460/902] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:11 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:12.382566 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:12.383283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:12.390074 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:12.390535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:12.390991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:12.391702 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:12.392389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:12.393046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:12.408347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:12.542279 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:12.554023 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:12.555867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:12.557344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a8d0bc65-1010-4075-afc2-0d44a29719f7 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1739 microversion: 2.20 time: 0.179402 Sep 02 09:15:12.558296 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 443/903] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:12 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:13.580008 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:13.582678 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:13.590611 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:13.591115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:13.591989 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:13.592914 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:13.593371 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:13.593795 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:13.598809 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:13.808028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:13.823804 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:13.825198 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:13.826376 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-39792318-a5c7-42fe-891e-382ac14938b9 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1739 microversion: 2.20 time: 0.250953 Sep 02 09:15:13.827102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 461/904] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:13 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:14.854506 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:14.855936 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:14.862513 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:14.863156 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:14.863832 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:14.864760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:14.865460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:14.866152 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:15.112528 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:15.122361 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:15.124203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:15.125539 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-78ab19de-344b-4424-bffc-e309209669fb tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1739 microversion: 2.20 time: 0.276621 Sep 02 09:15:15.126583 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 444/905] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:14 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:16.152471 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:16.156313 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:16.163443 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:16.164269 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:16.164932 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:16.166031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:16.166732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:16.167430 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:16.226344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-de16762c-a054-4f40-bfed-efb7c0dfb3bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:16.229459 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-de16762c-a054-4f40-bfed-efb7c0dfb3bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:16.245013 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de16762c-a054-4f40-bfed-efb7c0dfb3bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:16.245661 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de16762c-a054-4f40-bfed-efb7c0dfb3bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:16.246204 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de16762c-a054-4f40-bfed-efb7c0dfb3bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:16.248158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de16762c-a054-4f40-bfed-efb7c0dfb3bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:16.249698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de16762c-a054-4f40-bfed-efb7c0dfb3bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:16.250269 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de16762c-a054-4f40-bfed-efb7c0dfb3bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:16.296128 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-de16762c-a054-4f40-bfed-efb7c0dfb3bf tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.073901 Sep 02 09:15:16.296879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 445/906] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:15:16 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:15:16.327051 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:16.342949 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:16.344680 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:16.346777 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b1f0dd11-d4f3-402a-93f3-0acde2bb35fd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1739 microversion: 2.20 time: 0.199300 Sep 02 09:15:16.347355 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 462/907] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:16 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:16.406412 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06ab8913-7413-4bc3-bf47-41e45e5c76a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:16.407816 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06ab8913-7413-4bc3-bf47-41e45e5c76a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:16.415579 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ab8913-7413-4bc3-bf47-41e45e5c76a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:16.416213 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ab8913-7413-4bc3-bf47-41e45e5c76a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:16.416878 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ab8913-7413-4bc3-bf47-41e45e5c76a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:16.417993 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ab8913-7413-4bc3-bf47-41e45e5c76a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:16.418667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ab8913-7413-4bc3-bf47-41e45e5c76a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:16.419188 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ab8913-7413-4bc3-bf47-41e45e5c76a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:16.464316 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06ab8913-7413-4bc3-bf47-41e45e5c76a3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/d1e08c9e-3361-4fa0-8147-5e16aec2b236" status: 200 len: 194 microversion: 2.1 time: 0.061853 Sep 02 09:15:16.478319 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 446/908] 10.222.0.36 () {58 vars in 1413 bytes} [Fri Sep 2 09:15:16 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/d1e08c9e-3361-4fa0-8147-5e16aec2b236 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:15:16.478853 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:16.479406 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:16.490949 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:16.491757 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:16.492210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:16.492936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:16.493401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:16.493826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:16.599572 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lazy-loading 'services' on Instance uuid 9945d695-4910-47a7-85df-8eedda254a17 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:15:16.686053 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c5fb2bae-30ed-4499-8059-9d2ee3d51382 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/d1e08c9e-3361-4fa0-8147-5e16aec2b236" status: 202 len: 0 microversion: 2.1 time: 0.211690 Sep 02 09:15:16.687367 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 463/909] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:15:16 2022] DELETE /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/d1e08c9e-3361-4fa0-8147-5e16aec2b236 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:15:17.370003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:17.370646 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:17.377689 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:17.378181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:17.378618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:17.379344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:17.379799 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:17.380227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:17.509996 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:17.517959 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:17.519426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:17.520593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-809fe903-eba0-4f0e-a3e1-e0c50b189625 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1739 microversion: 2.20 time: 0.154463 Sep 02 09:15:17.521147 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 447/910] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:17 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:18.545065 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:18.545761 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:18.551947 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:18.552436 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:18.552876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:18.553603 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:18.554061 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:18.554486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:18.779862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:18.788938 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:18.790524 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:18.791770 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a6f1ea8e-e708-4f59-9b89-f1b4aa788364 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1721 microversion: 2.20 time: 0.252428 Sep 02 09:15:18.792512 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 464/911] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:18 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:18.879713 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-797d9541-59af-49f7-b7f3-2a561eb18679 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:18.880238 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-797d9541-59af-49f7-b7f3-2a561eb18679 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:18.886572 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-797d9541-59af-49f7-b7f3-2a561eb18679 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:18.887058 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-797d9541-59af-49f7-b7f3-2a561eb18679 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:18.887537 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-797d9541-59af-49f7-b7f3-2a561eb18679 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:18.888233 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-797d9541-59af-49f7-b7f3-2a561eb18679 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:18.888685 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-797d9541-59af-49f7-b7f3-2a561eb18679 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:18.889109 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-797d9541-59af-49f7-b7f3-2a561eb18679 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:18.917097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-797d9541-59af-49f7-b7f3-2a561eb18679 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/87b1c902-dfa0-427d-9f05-109ccc29dc50" status: 200 len: 194 microversion: 2.1 time: 0.041884 Sep 02 09:15:18.917676 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 448/912] 10.222.0.36 () {58 vars in 1413 bytes} [Fri Sep 2 09:15:18 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/87b1c902-dfa0-427d-9f05-109ccc29dc50 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:15:18.929552 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:18.930185 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:18.932302 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=41 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:18.937712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:18.938296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:18.938624 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:18.939336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:18.940446 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:18.940899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:19.026371 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lazy-loading 'services' on Instance uuid 9945d695-4910-47a7-85df-8eedda254a17 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:15:19.098786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b1208f58-bfb2-4132-a169-605cccd302f5 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/87b1c902-dfa0-427d-9f05-109ccc29dc50" status: 202 len: 0 microversion: 2.1 time: 0.172720 Sep 02 09:15:19.099418 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 465/913] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:15:18 2022] DELETE /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments/87b1c902-dfa0-427d-9f05-109ccc29dc50 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:15:19.815616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:19.816222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:19.822178 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:19.822662 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:19.823244 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:19.824117 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:19.824601 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:19.825024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:19.958080 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:19.966006 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:19.967472 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:19.968611 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c7d04420-1893-4b30-b16b-d1047652b227 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1721 microversion: 2.20 time: 0.157187 Sep 02 09:15:19.969157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 449/914] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:19 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:20.993061 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:20.993832 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:21.000920 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:21.001486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:21.002022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:21.002940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:21.003651 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:21.004141 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:21.152373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:21.171893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:21.173320 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:21.174597 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-64551fcb-cffb-473a-9488-94b2d13f89cf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1721 microversion: 2.20 time: 0.185992 Sep 02 09:15:21.175353 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 466/915] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:20 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:15:21.941681 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-f1296ade-c2ec-4892-bce8-f3b5421fb973 req-6abf2c7e-8d85-421d-a870-dbc38d0137f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde844d8-53ed-4ac1-813f-80203a754084", "name": "network-vif-unplugged", "status": "completed", "tag": "d6bad915-ef87-444d-aa2b-102e8e9b311d"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:15:21.953057 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f1296ade-c2ec-4892-bce8-f3b5421fb973 req-6abf2c7e-8d85-421d-a870-dbc38d0137f5 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:21.953533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f1296ade-c2ec-4892-bce8-f3b5421fb973 req-6abf2c7e-8d85-421d-a870-dbc38d0137f5 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:21.953963 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f1296ade-c2ec-4892-bce8-f3b5421fb973 req-6abf2c7e-8d85-421d-a870-dbc38d0137f5 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:21.965781 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.compute.server_external_events [req-f1296ade-c2ec-4892-bce8-f3b5421fb973 req-6abf2c7e-8d85-421d-a870-dbc38d0137f5 service nova] Unable to find a host for instance dde844d8-53ed-4ac1-813f-80203a754084. Dropping event network-vif-unplugged {{(pid=120572) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 02 09:15:21.966640 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-f1296ade-c2ec-4892-bce8-f3b5421fb973 req-6abf2c7e-8d85-421d-a870-dbc38d0137f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028795 Sep 02 09:15:21.967400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 450/916] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 02 09:15:22.197920 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:22.198526 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:22.204883 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.206138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.206595 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.207312 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.207764 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.208184 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.337541 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:22.346150 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:22.347709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:22.348964 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-593b8301-0995-4094-86a1-857579151678 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1664 microversion: 2.20 time: 0.154952 Sep 02 09:15:22.349593 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 467/917] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:22 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:22.370868 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-62413f52-4bd4-4651-a75d-e603aa278c22 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c060f5e8-d9fe-41c5-aff4-b349370cbdfe"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:15:22.373264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-62413f52-4bd4-4651-a75d-e603aa278c22 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:22.379634 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62413f52-4bd4-4651-a75d-e603aa278c22 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.380117 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62413f52-4bd4-4651-a75d-e603aa278c22 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.380550 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62413f52-4bd4-4651-a75d-e603aa278c22 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.381236 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62413f52-4bd4-4651-a75d-e603aa278c22 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.381689 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62413f52-4bd4-4651-a75d-e603aa278c22 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.382116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62413f52-4bd4-4651-a75d-e603aa278c22 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.387869 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-61c9a46a-ced7-47c2-b96e-f8995bb5482d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:22.390170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-61c9a46a-ced7-47c2-b96e-f8995bb5482d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:22.396758 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c9a46a-ced7-47c2-b96e-f8995bb5482d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.397235 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c9a46a-ced7-47c2-b96e-f8995bb5482d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.397697 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c9a46a-ced7-47c2-b96e-f8995bb5482d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.398578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c9a46a-ced7-47c2-b96e-f8995bb5482d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.399056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c9a46a-ced7-47c2-b96e-f8995bb5482d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.399505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c9a46a-ced7-47c2-b96e-f8995bb5482d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.427952 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-61c9a46a-ced7-47c2-b96e-f8995bb5482d tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043896 Sep 02 09:15:22.428517 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 468/918] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:15:22 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 09:15:22.553252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ae41d4de-0132-4e83-ad00-266bcd0919f2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:22.555996 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ae41d4de-0132-4e83-ad00-266bcd0919f2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:22.563257 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae41d4de-0132-4e83-ad00-266bcd0919f2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.563749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae41d4de-0132-4e83-ad00-266bcd0919f2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.564191 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae41d4de-0132-4e83-ad00-266bcd0919f2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.565400 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae41d4de-0132-4e83-ad00-266bcd0919f2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.565858 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae41d4de-0132-4e83-ad00-266bcd0919f2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.566281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae41d4de-0132-4e83-ad00-266bcd0919f2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.596692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ae41d4de-0132-4e83-ad00-266bcd0919f2 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047584 Sep 02 09:15:22.597254 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 469/919] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:15:22 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 09:15:22.649226 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-62413f52-4bd4-4651-a75d-e603aa278c22 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282311 Sep 02 09:15:22.649824 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 451/920] 10.222.0.36 () {62 vars in 1364 bytes} [Fri Sep 2 09:15:22 2022] POST /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/os-volume_attachments => generated 188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:15:22.664121 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:22.664614 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:22.670654 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.671826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.672260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.672950 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.673533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.674492 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.707734 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:15:22.780000 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eb69d941-eecd-4918-a9d1-a6c65927c095 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:22.780622 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eb69d941-eecd-4918-a9d1-a6c65927c095 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:22.786599 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb69d941-eecd-4918-a9d1-a6c65927c095 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.787193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb69d941-eecd-4918-a9d1-a6c65927c095 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.787723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb69d941-eecd-4918-a9d1-a6c65927c095 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.788505 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb69d941-eecd-4918-a9d1-a6c65927c095 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.789029 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb69d941-eecd-4918-a9d1-a6c65927c095 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.789514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb69d941-eecd-4918-a9d1-a6c65927c095 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.801567 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66813bf4-fc2b-42fd-9543-029a01fe4b68 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 204 len: 0 microversion: 2.1 time: 0.141164 Sep 02 09:15:22.802379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 470/921] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:15:22 2022] DELETE /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:15:22.811051 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:22.811876 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:22.818305 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.818864 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.819427 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.820205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:22.820717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:22.821205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:22.970181 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:22.978208 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ddfb20da-778f-4504-a016-247e8e9fa95f tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1673 microversion: 2.1 time: 0.171342 Sep 02 09:15:22.978774 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 471/922] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:22 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:15:23.088688 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eb69d941-eecd-4918-a9d1-a6c65927c095 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/os-volume_attachments/c060f5e8-d9fe-41c5-aff4-b349370cbdfe" status: 202 len: 0 microversion: 2.20 time: 0.312980 Sep 02 09:15:23.089423 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 452/923] 10.222.0.36 () {60 vars in 1457 bytes} [Fri Sep 2 09:15:22 2022] DELETE /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/os-volume_attachments/c060f5e8-d9fe-41c5-aff4-b349370cbdfe => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:15:23.148372 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:15:23.148965 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:23.154866 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:23.155397 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:23.155838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:23.156547 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:23.157022 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:23.157429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:23.186443 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120573) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 09:15:23.253893 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-75ed948d-90de-47d9-b898-9a53e23ae414 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "POST /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/action" status: 202 len: 0 microversion: 2.20 time: 0.109295 Sep 02 09:15:23.254527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 472/924] 10.222.0.36 () {62 vars in 1319 bytes} [Fri Sep 2 09:15:23 2022] POST /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 02 09:15:23.262587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:23.263235 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:23.271033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:23.271549 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:23.271991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:23.272690 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:23.273247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:23.273784 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:23.434301 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:23.443046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:23.444512 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:23.445667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0259982c-4830-47a8-94a4-2be14043a078 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1672 microversion: 2.20 time: 0.187093 Sep 02 09:15:23.446222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 453/925] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:23 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:24.000410 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:24.001025 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:24.006928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:24.007462 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:24.007902 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:24.008590 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:24.009047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:24.009471 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:24.147144 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:24.154952 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:24.159245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d86036d8-11b7-4edb-b0fb-7ea001bbf8e9 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1673 microversion: 2.1 time: 0.161880 Sep 02 09:15:24.159823 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 473/926] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:23 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:15:24.467675 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:24.468221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:24.475127 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:24.475614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:24.476054 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:24.476741 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:24.477199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:24.477624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:24.609988 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:24.619194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:24.620685 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:24.621869 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-24246d84-b88a-46c1-a8b7-88ad64370984 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1672 microversion: 2.20 time: 0.158122 Sep 02 09:15:24.622429 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 454/927] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:24 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:25.182476 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:25.183685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:25.192170 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:25.192999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:25.193770 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:25.194592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:25.195233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:25.195931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:25.405318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:25.414710 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-514f0e55-28e3-444d-8588-7b287e3f9750 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1673 microversion: 2.1 time: 0.237654 Sep 02 09:15:25.415653 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 474/928] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:25 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:15:25.647595 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:25.648299 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:25.654704 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:25.655413 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:25.655907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:25.656679 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:25.657234 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:25.657761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:25.677390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:26.025816 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:26.035035 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:26.036611 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:26.038037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5f4d6893-8702-4039-9b14-d969e953e0c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.396565 Sep 02 09:15:26.038914 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 455/929] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:25 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:26.422533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-26ce73e9-38e4-44d7-854d-489f804365fb req-0048795e-4771-4700-ba1d-fcb9cd864208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9945d695-4910-47a7-85df-8eedda254a17", "name": "network-vif-deleted", "tag": "0d64b912-fc8e-4641-b22d-7c0cc297786c"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:15:26.439115 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:26.439795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:26.440971 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-26ce73e9-38e4-44d7-854d-489f804365fb req-0048795e-4771-4700-ba1d-fcb9cd864208 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:26.441538 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-26ce73e9-38e4-44d7-854d-489f804365fb req-0048795e-4771-4700-ba1d-fcb9cd864208 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:26.442044 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-26ce73e9-38e4-44d7-854d-489f804365fb req-0048795e-4771-4700-ba1d-fcb9cd864208 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:26.451174 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:26.451982 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:26.452618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:26.453992 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:26.455690 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:26.456934 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:26.462812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-26ce73e9-38e4-44d7-854d-489f804365fb req-0048795e-4771-4700-ba1d-fcb9cd864208 service nova] Creating event network-vif-deleted:0d64b912-fc8e-4641-b22d-7c0cc297786c for instance 9945d695-4910-47a7-85df-8eedda254a17 on hv-cinder-85535 Sep 02 09:15:26.467994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-26ce73e9-38e4-44d7-854d-489f804365fb req-0048795e-4771-4700-ba1d-fcb9cd864208 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049556 Sep 02 09:15:26.468993 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 475/930] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:15:26.556675 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4210f948dc7e4a5bac61d10eb6a62eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6a6fe5db0a452a83dde4aac26b0161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:26.565957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-48fd1eb9-ff96-407e-8f55-ddd0a103fbaa tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 200 len: 1322 microversion: 2.1 time: 0.131898 Sep 02 09:15:26.567434 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 456/931] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:26 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 1322 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:15:27.062843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:27.063579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:27.070179 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:27.070656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:27.071110 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:27.071798 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:27.072250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:27.072668 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:27.256392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:27.265579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:27.267009 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:27.274125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d881bc92-39a4-42c6-a13e-9dc9310243d4 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.215471 Sep 02 09:15:27.275847 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 476/932] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:27 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:27.591312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:27.592621 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:27.595179 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=46 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:27.605067 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:27.605563 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:27.606002 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:27.606716 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:27.607286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:27.607659 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:27.624232 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] HTTP exception thrown: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Request method failure captured: Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 HTTP/1.1 Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcggL-twjMvPeUaoCJUJ9btABS--Chtf9joKHOz6WvMDeaMrH9dRCpgQHb0ACnnJGJkfU6Zta7tElnUv2Y63gxDd66dxppfA0PxPx48ZH_YXlJuTxngAO3jdijPWspPKdJLf8MwBpsaDOIgV0vtjhOaMRyTYSWQQNOf5whbU9UHNjo0 Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:27.625921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2d6a6fe5db0a452a83dde4aac26b0161", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 4210f948dc7e4a5bac61d10eb6a62eee Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:27.628435 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '9945d695-4910-47a7-85df-8eedda254a17'} Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:27.629382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:27.631003 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:27.632419 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Returning 404 to user: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:27.632419 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bdbdf765-fd1d-4f8e-9f21-d530416c1c72 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 404 len: 111 microversion: 2.1 time: 0.042581 Sep 02 09:15:27.632419 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 457/933] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:27 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:27.637083 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cdd15096-1658-4390-91d2-b70a92bd9d90 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '.version_select at 0x7f54bc33b8b0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:27.670899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cdd15096-1658-4390-91d2-b70a92bd9d90 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-618606796" status: 202 len: 0 microversion: 2.1 time: 0.036669 Sep 02 09:15:27.672698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 477/934] 10.222.0.36 () {58 vars in 1218 bytes} [Fri Sep 2 09:15:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-618606796 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:15:28.298564 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:28.303182 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:28.320081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:28.320851 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:28.321535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:28.325380 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:28.326146 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:28.326826 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:28.622548 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:28.632380 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:28.634033 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:28.648419 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cf3a90cb-6cab-432c-86d9-b70dc49fc3df tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.354230 Sep 02 09:15:28.650679 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 458/935] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:28 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:29.016288 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-725ddef0-acf5-4e4e-8222-a62ae46c4b14 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:29.017440 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-725ddef0-acf5-4e4e-8222-a62ae46c4b14 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:29.031296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-725ddef0-acf5-4e4e-8222-a62ae46c4b14 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:29.031681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-725ddef0-acf5-4e4e-8222-a62ae46c4b14 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:29.032125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-725ddef0-acf5-4e4e-8222-a62ae46c4b14 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:29.032846 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-725ddef0-acf5-4e4e-8222-a62ae46c4b14 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:29.033344 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-725ddef0-acf5-4e4e-8222-a62ae46c4b14 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:29.033842 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-725ddef0-acf5-4e4e-8222-a62ae46c4b14 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:29.076390 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-725ddef0-acf5-4e4e-8222-a62ae46c4b14 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/ips" status: 200 len: 151 microversion: 2.1 time: 0.063934 Sep 02 09:15:29.079262 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 478/936] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:15:29 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/ips => generated 151 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:15:29.674407 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:29.675654 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:29.682058 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:29.682785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:29.683423 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:29.684321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:29.684945 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:29.685544 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:29.873213 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:29.886361 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:29.888982 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:29.890648 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b26558af-8d4d-40a9-8892-db8554dd0daf tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.220620 Sep 02 09:15:29.891721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 459/937] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:29 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:30.522751 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cee9a422-9aaa-469a-9d8b-13f145b585c8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "547e67e2-afc3-463c-ae4d-c69214db7583"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:15:30.532769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cee9a422-9aaa-469a-9d8b-13f145b585c8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:30.544554 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee9a422-9aaa-469a-9d8b-13f145b585c8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:30.545138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee9a422-9aaa-469a-9d8b-13f145b585c8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:30.545709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee9a422-9aaa-469a-9d8b-13f145b585c8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:30.546504 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee9a422-9aaa-469a-9d8b-13f145b585c8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:30.547057 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee9a422-9aaa-469a-9d8b-13f145b585c8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:30.547576 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee9a422-9aaa-469a-9d8b-13f145b585c8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:30.917397 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:30.918564 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:30.928441 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:30.929049 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:30.929497 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:30.930208 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:30.930853 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:30.931317 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:31.091293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:31.099825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:31.101263 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:31.102420 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d1d3bc86-9365-40e2-b0bd-112aea37ad6b tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.189265 Sep 02 09:15:31.102972 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 460/938] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:30 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:31.395804 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:31.396701 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:31.402901 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:31.403658 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:31.404285 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:31.405414 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:31.406037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:31.406627 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:31.423787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] HTTP exception thrown: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Request method failure captured: Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 HTTP/1.1 Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcggL-twjMvPeUaoCJUJ9btABS--Chtf9joKHOz6WvMDeaMrH9dRCpgQHb0ACnnJGJkfU6Zta7tElnUv2Y63gxDd66dxppfA0PxPx48ZH_YXlJuTxngAO3jdijPWspPKdJLf8MwBpsaDOIgV0vtjhOaMRyTYSWQQNOf5whbU9UHNjo0 Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:31.426312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2d6a6fe5db0a452a83dde4aac26b0161", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 4210f948dc7e4a5bac61d10eb6a62eee Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.427667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '9945d695-4910-47a7-85df-8eedda254a17'} Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:31.428392 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.429649 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.430849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Returning 404 to user: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:31.430849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5dea04be-f6e4-4da8-8dd0-321a0760dbf3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 404 len: 111 microversion: 2.1 time: 0.036564 Sep 02 09:15:31.430849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 461/939] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:15:31 2022] DELETE /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 09:15:31.436167 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:31.436790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 9945d695-4910-47a7-85df-8eedda254a17] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:31.443085 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:31.443770 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:31.444215 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:31.444921 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:31.445380 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:31.445876 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:31.467725 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] HTTP exception thrown: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Request method failure captured: Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 HTTP/1.1 Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcggL-twjMvPeUaoCJUJ9btABS--Chtf9joKHOz6WvMDeaMrH9dRCpgQHb0ACnnJGJkfU6Zta7tElnUv2Y63gxDd66dxppfA0PxPx48ZH_YXlJuTxngAO3jdijPWspPKdJLf8MwBpsaDOIgV0vtjhOaMRyTYSWQQNOf5whbU9UHNjo0 Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:31.469510 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2d6a6fe5db0a452a83dde4aac26b0161", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 4210f948dc7e4a5bac61d10eb6a62eee Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.471642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '9945d695-4910-47a7-85df-8eedda254a17'} Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:31.472508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. Sep 02 09:15:31.473977 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:31.480441 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Returning 404 to user: Instance 9945d695-4910-47a7-85df-8eedda254a17 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:31.481591 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2ef6629e-42d9-40d5-a0c7-df296ff423b3 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17" status: 404 len: 111 microversion: 2.1 time: 0.049229 Sep 02 09:15:31.482620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 462/940] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:31 2022] GET /compute/v2.1/servers/9945d695-4910-47a7-85df-8eedda254a17 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:32.128280 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:32.129184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:32.135881 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:32.136362 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:32.136801 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:32.137489 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:32.138257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:32.143181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:32.319613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:32.334783 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:32.336582 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:32.337839 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4dc14e95-f3fc-4677-b59e-1ce7b4e904ab tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.213728 Sep 02 09:15:32.339710 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 463/941] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:32 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:15:32.655330 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:32.655825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:32.662365 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:32.662846 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:32.663478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:32.664171 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:32.664627 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:32.665044 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:32.678415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] HTTP exception thrown: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Request method failure captured: Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 HTTP/1.1 Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcggL-twjMvPeUaoCJUJ9btABS--Chtf9joKHOz6WvMDeaMrH9dRCpgQHb0ACnnJGJkfU6Zta7tElnUv2Y63gxDd66dxppfA0PxPx48ZH_YXlJuTxngAO3jdijPWspPKdJLf8MwBpsaDOIgV0vtjhOaMRyTYSWQQNOf5whbU9UHNjo0 Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:32.680267 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2d6a6fe5db0a452a83dde4aac26b0161", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 4210f948dc7e4a5bac61d10eb6a62eee Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.681831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '06c2d542-631f-4763-84db-ce759de2b8d8'} Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:32.682760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.684221 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.686341 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Returning 404 to user: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:32.687227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-952c40cb-87a6-4f61-90c6-a62afe9a9d83 tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 404 len: 111 microversion: 2.1 time: 0.035892 Sep 02 09:15:32.687783 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 464/942] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:15:32 2022] DELETE /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:32.695831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:32.696691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] [instance: 06c2d542-631f-4763-84db-ce759de2b8d8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:32.702703 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:32.703234 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:32.703990 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:32.704695 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:32.705670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:32.706344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:32.720004 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] HTTP exception thrown: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Request method failure captured: Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 HTTP/1.1 Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcggL-twjMvPeUaoCJUJ9btABS--Chtf9joKHOz6WvMDeaMrH9dRCpgQHb0ACnnJGJkfU6Zta7tElnUv2Y63gxDd66dxppfA0PxPx48ZH_YXlJuTxngAO3jdijPWspPKdJLf8MwBpsaDOIgV0vtjhOaMRyTYSWQQNOf5whbU9UHNjo0 Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:32.722064 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d6a6fe5db0a452a83dde4aac26b0161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2d6a6fe5db0a452a83dde4aac26b0161", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 2d6a6fe5db0a452a83dde4aac26b0161 Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1213603183 Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 4210f948dc7e4a5bac61d10eb6a62eee Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-1213603183-project Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.723765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '06c2d542-631f-4763-84db-ce759de2b8d8'} Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:32.724694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. Sep 02 09:15:32.726273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:32.727670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] Returning 404 to user: Instance 06c2d542-631f-4763-84db-ce759de2b8d8 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:32.727670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fcbb9472-a43c-498c-a01b-841864e9a99a tempest-AttachVolumeTestJSON-1213603183 tempest-AttachVolumeTestJSON-1213603183-project] 10.222.0.36 "GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8" status: 404 len: 111 microversion: 2.1 time: 0.031479 Sep 02 09:15:32.727670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 465/943] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:32 2022] GET /compute/v2.1/servers/06c2d542-631f-4763-84db-ce759de2b8d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:33.370133 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:33.371509 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:33.384389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:33.384873 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:33.385708 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:33.386410 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:33.387040 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:33.387676 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:33.652692 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:33.668746 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:33.673627 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:33.677422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a3b5c09f-4792-4cf5-9af0-ad4bea276fca tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.311551 Sep 02 09:15:33.678860 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 466/944] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:33 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:15:34.701103 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:34.702439 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:34.713950 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:34.716742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:34.717651 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:34.718950 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:34.720663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:34.722780 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:35.100351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:35.112939 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:35.115704 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:35.117556 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c9dcf9d3-4015-4669-841a-56756fb0e2c8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.420666 Sep 02 09:15:35.118868 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 467/945] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:34 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:15:36.141703 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:36.143651 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:36.155130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:36.158043 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:36.158937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:36.159699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:36.160165 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:36.160596 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:36.486645 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:36.502697 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:36.507273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:36.509588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8a1f0914-461c-414b-8a3c-326123849647 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.371646 Sep 02 09:15:36.510358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 468/946] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:36 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:15:37.190655 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cee9a422-9aaa-469a-9d8b-13f145b585c8 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "POST /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.676224 Sep 02 09:15:37.191545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 479/947] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:15:30 2022] POST /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-volume_attachments => generated 194 bytes in 6679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:15:37.537498 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:37.538791 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:37.545426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:37.545929 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:37.546352 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:37.547154 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:37.547617 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:37.548571 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:37.681467 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:37.690569 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:37.692070 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:37.693265 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-77fb3310-0241-404c-bd19-3e1d0207b1db tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.163525 Sep 02 09:15:37.693825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 469/948] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:37 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:38.717077 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:38.717712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:38.724866 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:38.725355 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:38.725791 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:38.726486 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:38.726940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:38.727393 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:38.863661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:38.871701 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:38.873125 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:38.874272 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f34ef25d-3ab4-4161-954f-6ea4f13e1ef3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.161916 Sep 02 09:15:38.874819 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 480/949] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:38 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:39.901570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:39.902180 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:39.909054 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:39.909529 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:39.909957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:39.910636 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:39.911108 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:39.911527 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:40.034904 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:40.042856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:40.044308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:40.045446 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-01434cc4-e161-4a67-88d3-cca133d5dd34 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.147841 Sep 02 09:15:40.045997 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 470/950] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:39 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:41.068732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:41.069285 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:41.075763 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:41.076249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:41.076685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:41.077372 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:41.077830 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:41.078254 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:41.209017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:41.217697 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:41.219324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:41.220667 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-00dc4798-81ba-4023-bf5b-a0762458d799 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.156411 Sep 02 09:15:41.232899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 481/951] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:41 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:42.243420 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:42.244037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:42.250470 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:42.250954 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:42.251423 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:42.252694 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:42.253151 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:42.253575 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:42.388708 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:42.396786 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:42.398211 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:42.399382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1645cf08-c850-44c8-a6a2-cdd4028de6bd tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.159943 Sep 02 09:15:42.399932 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 471/952] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:42 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:42.424617 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-33975bf9-cf6f-48c0-842f-daf769a65c81 req-3d260cd5-4664-4f60-9bf4-2c9d1e4b176a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde844d8-53ed-4ac1-813f-80203a754084", "name": "network-vif-plugged", "status": "completed", "tag": "d6bad915-ef87-444d-aa2b-102e8e9b311d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:15:42.435499 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-33975bf9-cf6f-48c0-842f-daf769a65c81 req-3d260cd5-4664-4f60-9bf4-2c9d1e4b176a service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:42.435974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-33975bf9-cf6f-48c0-842f-daf769a65c81 req-3d260cd5-4664-4f60-9bf4-2c9d1e4b176a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:42.436397 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-33975bf9-cf6f-48c0-842f-daf769a65c81 req-3d260cd5-4664-4f60-9bf4-2c9d1e4b176a service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:42.448036 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-33975bf9-cf6f-48c0-842f-daf769a65c81 req-3d260cd5-4664-4f60-9bf4-2c9d1e4b176a service nova] Creating event network-vif-plugged:d6bad915-ef87-444d-aa2b-102e8e9b311d for instance dde844d8-53ed-4ac1-813f-80203a754084 on hv-cinder-85535 Sep 02 09:15:42.452787 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-33975bf9-cf6f-48c0-842f-daf769a65c81 req-3d260cd5-4664-4f60-9bf4-2c9d1e4b176a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032346 Sep 02 09:15:42.453380 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 482/953] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:15:43.422280 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:43.423009 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:43.430008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:43.430483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:43.430915 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:43.431626 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:43.432078 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:43.432497 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:43.566029 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:43.574270 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:43.575744 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:43.576901 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-51587b9d-1745-4324-a72c-5899b43248e5 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.158567 Sep 02 09:15:43.577448 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 472/954] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:43 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:44.600817 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:44.601503 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:44.607579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:44.607999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:44.608433 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:44.609119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:44.609568 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:44.609985 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:44.736260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:44.744498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:44.745932 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:44.747111 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fc505452-a90c-43d5-a728-3f0bc490cfb2 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.151743 Sep 02 09:15:44.747671 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 483/955] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:44 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:45.773097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:45.773772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:45.780515 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:45.781005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:45.781551 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:45.782256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:45.782707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:45.783676 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:45.916582 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:45.924603 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:45.926037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:45.927218 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e3795913-7e57-45e5-9ceb-dae62e245d50 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.161500 Sep 02 09:15:45.927774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 473/956] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:45 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:46.951828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:46.955201 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:46.963417 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:46.964034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:46.964491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:46.965197 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:46.965657 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:46.966084 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:47.127656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:47.137928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:47.139387 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:47.141724 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3666846c-6979-4056-a2cf-2abd7ff6a620 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1730 microversion: 2.20 time: 0.193463 Sep 02 09:15:47.143147 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 484/957] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:46 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:48.083686 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:48.084214 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:48.090719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:48.091237 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:48.091677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:48.092431 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:48.092889 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:48.093378 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:48.168462 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:48.169991 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:48.177386 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:48.178085 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:48.178512 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:48.179812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:48.180511 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:48.181184 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:48.191332 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lazy-loading 'services' on Instance uuid 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:15:48.266120 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:48.280574 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9e49b908-4735-4c3e-9e10-45db07ea0a44 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-volume_attachments/547e67e2-afc3-463c-ae4d-c69214db7583" status: 202 len: 0 microversion: 2.1 time: 0.201361 Sep 02 09:15:48.281337 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 474/958] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:15:48 2022] DELETE /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-volume_attachments/547e67e2-afc3-463c-ae4d-c69214db7583 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:15:48.292254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-10d66bef-23b0-4409-8ad2-a98de3ebad88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:48.293991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-10d66bef-23b0-4409-8ad2-a98de3ebad88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:48.301785 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10d66bef-23b0-4409-8ad2-a98de3ebad88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:48.302475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10d66bef-23b0-4409-8ad2-a98de3ebad88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:48.303246 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10d66bef-23b0-4409-8ad2-a98de3ebad88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:48.304094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10d66bef-23b0-4409-8ad2-a98de3ebad88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:48.304708 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10d66bef-23b0-4409-8ad2-a98de3ebad88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:48.305124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10d66bef-23b0-4409-8ad2-a98de3ebad88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:48.345094 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-10d66bef-23b0-4409-8ad2-a98de3ebad88 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056713 Sep 02 09:15:48.350416 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 475/959] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:15:48 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:15:48.367034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:48.375805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:48.377551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:48.378846 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-07088eec-04c7-4f96-8380-15b4113f9788 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1717 microversion: 2.20 time: 0.216647 Sep 02 09:15:48.379545 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 485/960] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:15:48 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1717 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:15:49.364047 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-da7c6687-2210-4790-a314-24c4e860a017 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:49.366393 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-da7c6687-2210-4790-a314-24c4e860a017 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:49.374058 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7c6687-2210-4790-a314-24c4e860a017 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:49.374827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7c6687-2210-4790-a314-24c4e860a017 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:49.375413 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7c6687-2210-4790-a314-24c4e860a017 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:49.376224 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7c6687-2210-4790-a314-24c4e860a017 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:49.377010 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7c6687-2210-4790-a314-24c4e860a017 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:49.377617 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7c6687-2210-4790-a314-24c4e860a017 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:49.409802 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-da7c6687-2210-4790-a314-24c4e860a017 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053274 Sep 02 09:15:49.410723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 476/961] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:15:49 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:15:49.484714 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:49.485297 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:49.488523 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:49.494142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:49.494626 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:49.495225 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:49.496134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:49.496593 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:49.497016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:49.523689 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:15:49.622020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82d68ac7-da93-4c52-b632-95969225a564 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 204 len: 0 microversion: 2.1 time: 0.140931 Sep 02 09:15:49.622608 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 486/962] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:15:49 2022] DELETE /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:15:49.630941 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:49.631612 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:49.637689 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:49.638081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:49.638520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:49.639261 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:49.639779 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:49.640126 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:49.795421 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:49.803900 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-71297798-c080-4693-97c4-ab5cda0d27b4 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1683 microversion: 2.1 time: 0.176874 Sep 02 09:15:49.804587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 477/963] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:49 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:15:50.828536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:50.829243 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:50.836286 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:50.836903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:50.837577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:50.838531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:50.839254 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:50.839691 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:50.980685 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:50.989243 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4254840-41fd-4733-82b5-bc06105750b9 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1683 microversion: 2.1 time: 0.164880 Sep 02 09:15:50.989885 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 487/964] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:50 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:15:52.010447 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:52.011620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:52.018385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:52.018875 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:52.019350 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:52.020265 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:52.020869 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:52.021447 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:52.255462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b5ce2249a84c01ab57c03b656b2949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450e9ca29fb44e4808fa52de2f88470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:15:52.263042 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e170bc7b-4bd7-4012-8a4c-d0e02b25798a tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 200 len: 1683 microversion: 2.1 time: 0.257096 Sep 02 09:15:52.263828 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 478/965] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:52 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 1683 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:15:52.481849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-f9ff35b6-995b-4965-ad11-a6d6014351de req-64f9f05d-e59d-4fb4-b11e-0bb91b2ce456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05435fb1-da40-4636-b2f5-9b3ca2d38ce6", "name": "network-vif-deleted", "tag": "6c37f539-6cdf-4d8f-b705-3b7fe9b80284"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:15:52.491899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f9ff35b6-995b-4965-ad11-a6d6014351de req-64f9f05d-e59d-4fb4-b11e-0bb91b2ce456 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:52.492374 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f9ff35b6-995b-4965-ad11-a6d6014351de req-64f9f05d-e59d-4fb4-b11e-0bb91b2ce456 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:52.492864 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f9ff35b6-995b-4965-ad11-a6d6014351de req-64f9f05d-e59d-4fb4-b11e-0bb91b2ce456 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:52.504812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-f9ff35b6-995b-4965-ad11-a6d6014351de req-64f9f05d-e59d-4fb4-b11e-0bb91b2ce456 service nova] Creating event network-vif-deleted:6c37f539-6cdf-4d8f-b705-3b7fe9b80284 for instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 on hv-cinder-85535 Sep 02 09:15:52.509629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-f9ff35b6-995b-4965-ad11-a6d6014351de req-64f9f05d-e59d-4fb4-b11e-0bb91b2ce456 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031375 Sep 02 09:15:52.510235 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 488/966] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:15:53.286039 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:53.287291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:53.294024 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:53.294511 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:53.295241 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:53.295957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:53.296415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:53.296846 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:53.318523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 HTTP/1.1 Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:53.320530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:53.321966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '05435fb1-da40-4636-b2f5-9b3ca2d38ce6'} Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:53.322859 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:53.324186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:53.325307 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:53.325307 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4aa17ba0-54b8-4e19-a9af-7744be41e118 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 404 len: 111 microversion: 2.1 time: 0.041435 Sep 02 09:15:53.325944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 479/967] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:53 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:53.331395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-54fdb7b6-0c01-470b-8353-ea62cdcb9050 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '.version_select at 0x7f54bc3fea60>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:53.360002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-54fdb7b6-0c01-470b-8353-ea62cdcb9050 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639960503" status: 202 len: 0 microversion: 2.1 time: 0.032502 Sep 02 09:15:53.360700 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 489/968] 10.222.0.36 () {58 vars in 1221 bytes} [Fri Sep 2 09:15:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639960503 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:15:55.136937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:55.137436 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:55.144001 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:55.144546 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:55.144975 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:55.145705 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:55.146155 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:55.146573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:55.160171 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 HTTP/1.1 Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:55.161819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.163257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '05435fb1-da40-4636-b2f5-9b3ca2d38ce6'} Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:55.164157 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.165999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.167525 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:55.167525 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2872abda-6a4c-42d7-abba-2b6f2a3811ef tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 404 len: 111 microversion: 2.1 time: 0.030120 Sep 02 09:15:55.167525 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 480/969] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:15:55 2022] DELETE /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:55.172737 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:55.173480 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 05435fb1-da40-4636-b2f5-9b3ca2d38ce6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:55.180604 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:55.181102 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:55.181536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:55.182229 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:55.182697 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:55.183173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:55.196781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 HTTP/1.1 Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:15:55.198478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.200115 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '05435fb1-da40-4636-b2f5-9b3ca2d38ce6'} Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:55.200999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. Sep 02 09:15:55.202364 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:55.203527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 05435fb1-da40-4636-b2f5-9b3ca2d38ce6 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:55.203527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b601689d-9e21-45bb-addc-5441ce90d79c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6" status: 404 len: 111 microversion: 2.1 time: 0.031819 Sep 02 09:15:55.203527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 490/970] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:55 2022] GET /compute/v2.1/servers/05435fb1-da40-4636-b2f5-9b3ca2d38ce6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:56.347344 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:56.347924 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:56.354486 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:56.355061 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:56.355624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:56.356399 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:56.356868 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:56.357297 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:56.371281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 HTTP/1.1 Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:56.372867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.374367 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '84250eef-a56f-4e60-bbdc-95143e398d49'} Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:56.375273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.376625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.379021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:56.379021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d39e2654-38a5-4997-a912-f3cc7333c28d tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 404 len: 111 microversion: 2.1 time: 0.033829 Sep 02 09:15:56.379021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 481/971] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:15:56 2022] DELETE /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:56.383710 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:56.384318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 84250eef-a56f-4e60-bbdc-95143e398d49] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:56.390505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:56.390995 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:56.391463 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:56.392182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:56.392636 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:56.393060 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:56.395830 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:56.408002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 HTTP/1.1 Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:15:56.409561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.411240 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '84250eef-a56f-4e60-bbdc-95143e398d49'} Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:56.412162 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. Sep 02 09:15:56.413629 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.414901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 84250eef-a56f-4e60-bbdc-95143e398d49 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:56.414901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dbf59e2a-478a-4e07-bf1d-8e26b0535eba tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49" status: 404 len: 111 microversion: 2.1 time: 0.031179 Sep 02 09:15:56.414901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 491/972] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:56 2022] GET /compute/v2.1/servers/84250eef-a56f-4e60-bbdc-95143e398d49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:56.420208 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:56.420869 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:56.427831 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:56.428366 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:56.428853 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:56.429594 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:56.430103 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:56.430573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:56.445620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c HTTP/1.1 Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:56.447426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.448891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '66889932-9d4e-49d9-aaed-bf65390e4a7c'} Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:56.449723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.451191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.453750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:56.453750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7f6d0c5d-51bb-46c6-8156-214df7655e56 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 404 len: 111 microversion: 2.1 time: 0.032733 Sep 02 09:15:56.453750 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 482/973] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:15:56 2022] DELETE /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:56.459305 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:56.459926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 66889932-9d4e-49d9-aaed-bf65390e4a7c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:56.466529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:56.467021 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:56.467484 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:56.468182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:56.468640 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:56.469063 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:56.483177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c HTTP/1.1 Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:15:56.484708 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.486420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '66889932-9d4e-49d9-aaed-bf65390e4a7c'} Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:56.487377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. Sep 02 09:15:56.488854 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:56.490165 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 66889932-9d4e-49d9-aaed-bf65390e4a7c could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:56.490165 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fc4eb9d0-9c78-47ad-a9bd-326a0721ec7f tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c" status: 404 len: 111 microversion: 2.1 time: 0.031733 Sep 02 09:15:56.490165 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 492/974] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:56 2022] GET /compute/v2.1/servers/66889932-9d4e-49d9-aaed-bf65390e4a7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:59.734856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:59.735391 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:59.738487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=52 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:15:59.743639 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:59.744118 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:59.744547 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:59.745223 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:59.745667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:59.746085 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:59.759856 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e HTTP/1.1 Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:15:59.761389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.762951 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '6d27c557-5d34-45da-93ea-f6c2a86a807e'} Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:59.763879 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.765375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.766984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:59.766984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-48c9c8ad-12e2-453d-8207-7f0f00de9f69 tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 404 len: 111 microversion: 2.1 time: 0.031810 Sep 02 09:15:59.766984 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 483/975] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:15:59 2022] DELETE /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:15:59.771339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:15:59.771959 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] [instance: 6d27c557-5d34-45da-93ea-f6c2a86a807e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:15:59.778952 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:59.779457 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:59.779902 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:59.780606 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:15:59.781369 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:15:59.781960 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:15:59.799049 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] HTTP exception thrown: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Request method failure captured: Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e HTTP/1.1 Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgkJsd5jJZhgHhKYDg7-AbM0l8QJmlRPfZvgtqXYfDAMIvPxVekbLGX2mSkG8xB55esMoxuhJpVPLueIW3ayAYc9jv9CRNsbJnM12o-QHcj2KezdPt7_9Mo7BzMB_RGe5ZE5dzQt4dxvId6IvVzjt-PrbaYuRxIo-WTCoDLdb9CxWw Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:15:59.801177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3450e9ca29fb44e4808fa52de2f88470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3450e9ca29fb44e4808fa52de2f88470", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 3450e9ca29fb44e4808fa52de2f88470 Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1789711045 Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: e8b5ce2249a84c01ab57c03b656b2949 Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1789711045-project Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.802859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '6d27c557-5d34-45da-93ea-f6c2a86a807e'} Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:15:59.807188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. Sep 02 09:15:59.809453 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:15:59.810859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] Returning 404 to user: Instance 6d27c557-5d34-45da-93ea-f6c2a86a807e could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:15:59.810859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4cd339be-0448-4e45-a861-23121a68cb3c tempest-AttachVolumeNegativeTest-1789711045 tempest-AttachVolumeNegativeTest-1789711045-project] 10.222.0.36 "GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e" status: 404 len: 111 microversion: 2.1 time: 0.035048 Sep 02 09:15:59.810859 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 493/976] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:15:59 2022] GET /compute/v2.1/servers/6d27c557-5d34-45da-93ea-f6c2a86a807e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:16:04.553613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-329ab41f-58e4-4cd3-9250-32cd47e2a45b tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Action: 'create', calling method: .version_select at 0x7f54bc4a7430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-184203121", "metadata": {"Type": "work"}}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-329ab41f-58e4-4cd3-9250-32cd47e2a45b tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Request method failure captured: Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 121 Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcnUfU_z-eBw_qB-YvxSHxhibB01WSWeIwxj7p2RU8pRJvL0MvDiPK6WBlj7LpwQ_NFdtYmdsPk3oxx74m583_UEzKIrN5B3LFgNND3ggISM5k6Kdo5Mzd_4ene2DjnZv70-howBJq9BLJNHWcs9k0IuKQzg_hMy5OlupLUaL6u_q8c Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:16:04.573593 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a15cc4d6f0904b17b8e80af9bee42f9d", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 0cd2dbb2c54449eeb2811cbb5a1e3929 Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-184203121", "metadata": {"Type": "work"}}} Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: Sep 02 09:16:04.575288 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-184203121', 'metadata': {'Type': 'work'}}}} Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise error Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi '#$%' Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:04.576308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 09:16:04.577995 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 09:16:04.579754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 09:16:04.579754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.579754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-329ab41f-58e4-4cd3-9250-32cd47e2a45b tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:04.579754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-329ab41f-58e4-4cd3-9250-32cd47e2a45b tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136814 Sep 02 09:16:04.579754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 484/977] 10.222.0.36 () {60 vars in 1156 bytes} [Fri Sep 2 09:16:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:16:04.584945 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1fa22e20-9bf1-4c53-9d84-90fac97ee482 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Action: 'create', calling method: .version_select at 0x7f54bc6188b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-270866321", "metadata": {"Type": "work"}}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1fa22e20-9bf1-4c53-9d84-90fac97ee482 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Request method failure captured: Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 119 Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcnUfU_z-eBw_qB-YvxSHxhibB01WSWeIwxj7p2RU8pRJvL0MvDiPK6WBlj7LpwQ_NFdtYmdsPk3oxx74m583_UEzKIrN5B3LFgNND3ggISM5k6Kdo5Mzd_4ene2DjnZv70-howBJq9BLJNHWcs9k0IuKQzg_hMy5OlupLUaL6u_q8c Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:16:04.589563 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a15cc4d6f0904b17b8e80af9bee42f9d", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 0cd2dbb2c54449eeb2811cbb5a1e3929 Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-270866321", "metadata": {"Type": "work"}}} Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: Sep 02 09:16:04.591217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-270866321', 'metadata': {'Type': 'work'}}}} Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise error Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi '0' Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:04.592551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 09:16:04.594263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 09:16:04.595831 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 09:16:04.595831 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.595831 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1fa22e20-9bf1-4c53-9d84-90fac97ee482 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:04.595831 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1fa22e20-9bf1-4c53-9d84-90fac97ee482 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010212 Sep 02 09:16:04.595831 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 494/978] 10.222.0.36 () {60 vars in 1156 bytes} [Fri Sep 2 09:16:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:16:04.600210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a709792f-c979-4267-8ee8-12146ed7d289 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Action: 'create', calling method: .version_select at 0x7f54bc4cd670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1674281316", "metadata": {"Type": "work"}}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a709792f-c979-4267-8ee8-12146ed7d289 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Request method failure captured: Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 119 Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcnUfU_z-eBw_qB-YvxSHxhibB01WSWeIwxj7p2RU8pRJvL0MvDiPK6WBlj7LpwQ_NFdtYmdsPk3oxx74m583_UEzKIrN5B3LFgNND3ggISM5k6Kdo5Mzd_4ene2DjnZv70-howBJq9BLJNHWcs9k0IuKQzg_hMy5OlupLUaL6u_q8c Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:16:04.605664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a15cc4d6f0904b17b8e80af9bee42f9d", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 0cd2dbb2c54449eeb2811cbb5a1e3929 Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1674281316", "metadata": {"Type": "work"}}} Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: Sep 02 09:16:04.607240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1674281316', 'metadata': {'Type': 'work'}}}} Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise error Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi '' Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:04.608336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 09:16:04.610122 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 09:16:04.611540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 09:16:04.611540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.611540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a709792f-c979-4267-8ee8-12146ed7d289 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:04.611540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a709792f-c979-4267-8ee8-12146ed7d289 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010978 Sep 02 09:16:04.611540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 485/979] 10.222.0.36 () {60 vars in 1156 bytes} [Fri Sep 2 09:16:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:16:04.616735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-19affaf8-195b-4feb-96b1-1197c9ff7c61 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Calling method '.version_select at 0x7f54bc33b790>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:04.646513 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-19affaf8-195b-4feb-96b1-1197c9ff7c61 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] HTTP exception thrown: Volume tempest-invalid-1033396084 could not be found. Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-19affaf8-195b-4feb-96b1-1197c9ff7c61 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Request method failure captured: Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1033396084 HTTP/1.1 Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcnUfU_z-eBw_qB-YvxSHxhibB01WSWeIwxj7p2RU8pRJvL0MvDiPK6WBlj7LpwQ_NFdtYmdsPk3oxx74m583_UEzKIrN5B3LFgNND3ggISM5k6Kdo5Mzd_4ene2DjnZv70-howBJq9BLJNHWcs9k0IuKQzg_hMy5OlupLUaL6u_q8c Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:16:04.649749 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a15cc4d6f0904b17b8e80af9bee42f9d", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 0cd2dbb2c54449eeb2811cbb5a1e3929 Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Volume tempest-invalid-1033396084 could not be found. Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': 'tempest-invalid-1033396084'} Sep 02 09:16:04.652656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1033396084 could not be found. (HTTP 404) (Request-ID: req-99879022-58f7-4d7a-96c4-0b3794d86973) Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.653703 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 09:16:04.655263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1033396084 could not be found. Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:16:04.656970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1033396084 could not be found. Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1033396084 could not be found. Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-19affaf8-195b-4feb-96b1-1197c9ff7c61 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Returning 404 to user: Volume tempest-invalid-1033396084 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-19affaf8-195b-4feb-96b1-1197c9ff7c61 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1033396084" status: 404 len: 99 microversion: 2.1 time: 0.039268 Sep 02 09:16:04.658639 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 495/980] 10.222.0.36 () {58 vars in 1218 bytes} [Fri Sep 2 09:16:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1033396084 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 02 09:16:04.662389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-63ce4347-abac-4a9b-ae1b-3b34598a7664 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004935 Sep 02 09:16:04.662883 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 486/981] 10.222.0.36 () {58 vars in 1140 bytes} [Fri Sep 2 09:16:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 02 09:16:04.671380 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-afa3a5e1-b872-4ec8-8a42-fda5b7a88106 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003725 Sep 02 09:16:04.671875 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 496/982] 10.222.0.36 () {58 vars in 1137 bytes} [Fri Sep 2 09:16:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 09:16:04.680111 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2cbd9d13-f21f-4881-b9ef-8ed6c2fbc2f1 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Calling method '.version_select at 0x7f54bc4a7700>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:04.708675 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-2cbd9d13-f21f-4881-b9ef-8ed6c2fbc2f1 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] HTTP exception thrown: Volume 43e298c5-0635-4d37-9e98-8b942d4c78e7 could not be found. Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2cbd9d13-f21f-4881-b9ef-8ed6c2fbc2f1 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Request method failure captured: Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/os-volumes/43e298c5-0635-4d37-9e98-8b942d4c78e7 HTTP/1.1 Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcnUfU_z-eBw_qB-YvxSHxhibB01WSWeIwxj7p2RU8pRJvL0MvDiPK6WBlj7LpwQ_NFdtYmdsPk3oxx74m583_UEzKIrN5B3LFgNND3ggISM5k6Kdo5Mzd_4ene2DjnZv70-howBJq9BLJNHWcs9k0IuKQzg_hMy5OlupLUaL6u_q8c Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:16:04.710588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a15cc4d6f0904b17b8e80af9bee42f9d", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 0cd2dbb2c54449eeb2811cbb5a1e3929 Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Volume 43e298c5-0635-4d37-9e98-8b942d4c78e7 could not be found. Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '43e298c5-0635-4d37-9e98-8b942d4c78e7'} Sep 02 09:16:04.712168 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43e298c5-0635-4d37-9e98-8b942d4c78e7 could not be found. (HTTP 404) (Request-ID: req-6d5c6548-bc39-4e33-911f-ecbd31c3032e) Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.713257 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 09:16:04.714642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43e298c5-0635-4d37-9e98-8b942d4c78e7 could not be found. Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 09:16:04.716166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43e298c5-0635-4d37-9e98-8b942d4c78e7 could not be found. Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43e298c5-0635-4d37-9e98-8b942d4c78e7 could not be found. Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2cbd9d13-f21f-4881-b9ef-8ed6c2fbc2f1 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Returning 404 to user: Volume 43e298c5-0635-4d37-9e98-8b942d4c78e7 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2cbd9d13-f21f-4881-b9ef-8ed6c2fbc2f1 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/43e298c5-0635-4d37-9e98-8b942d4c78e7" status: 404 len: 109 microversion: 2.1 time: 0.035608 Sep 02 09:16:04.717723 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 487/983] 10.222.0.36 () {58 vars in 1248 bytes} [Fri Sep 2 09:16:04 2022] DELETE /compute/v2.1/os-volumes/43e298c5-0635-4d37-9e98-8b942d4c78e7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:16:04.724216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf57a6d0-2117-46be-8753-28ed988bb1a8 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Calling method '.version_select at 0x7f54bc3feb80>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:04.751610 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-cf57a6d0-2117-46be-8753-28ed988bb1a8 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] HTTP exception thrown: Volume 25d4fbb3-5e98-44ce-ad84-6d6e8c897249 could not be found. Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf57a6d0-2117-46be-8753-28ed988bb1a8 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Request method failure captured: Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/os-volumes/25d4fbb3-5e98-44ce-ad84-6d6e8c897249 HTTP/1.1 Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcnUfU_z-eBw_qB-YvxSHxhibB01WSWeIwxj7p2RU8pRJvL0MvDiPK6WBlj7LpwQ_NFdtYmdsPk3oxx74m583_UEzKIrN5B3LFgNND3ggISM5k6Kdo5Mzd_4ene2DjnZv70-howBJq9BLJNHWcs9k0IuKQzg_hMy5OlupLUaL6u_q8c Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:16:04.754116 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a15cc4d6f0904b17b8e80af9bee42f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a15cc4d6f0904b17b8e80af9bee42f9d", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: a15cc4d6f0904b17b8e80af9bee42f9d Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesNegativeTest-305132044 Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 0cd2dbb2c54449eeb2811cbb5a1e3929 Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesNegativeTest-305132044-project Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Volume 25d4fbb3-5e98-44ce-ad84-6d6e8c897249 could not be found. Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '25d4fbb3-5e98-44ce-ad84-6d6e8c897249'} Sep 02 09:16:04.755717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25d4fbb3-5e98-44ce-ad84-6d6e8c897249 could not be found. (HTTP 404) (Request-ID: req-cfc86015-a13d-414c-aedc-83e871f17bc1) Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.756607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:16:04.757961 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25d4fbb3-5e98-44ce-ad84-6d6e8c897249 could not be found. Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 09:16:04.759532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25d4fbb3-5e98-44ce-ad84-6d6e8c897249 could not be found. Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25d4fbb3-5e98-44ce-ad84-6d6e8c897249 could not be found. Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf57a6d0-2117-46be-8753-28ed988bb1a8 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] Returning 404 to user: Volume 25d4fbb3-5e98-44ce-ad84-6d6e8c897249 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf57a6d0-2117-46be-8753-28ed988bb1a8 tempest-VolumesNegativeTest-305132044 tempest-VolumesNegativeTest-305132044-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/25d4fbb3-5e98-44ce-ad84-6d6e8c897249" status: 404 len: 109 microversion: 2.1 time: 0.035853 Sep 02 09:16:04.761047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 497/984] 10.222.0.36 () {58 vars in 1245 bytes} [Fri Sep 2 09:16:04 2022] GET /compute/v2.1/os-volumes/25d4fbb3-5e98-44ce-ad84-6d6e8c897249 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:16:19.135431 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:19.136683 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=34 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:19.137465 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:19.138532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=5 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:16:19.141302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:19.142615 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:19.144555 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-98de7a89-7cbb-4522-8bfe-b89397f3dea9 req-471106a6-4f54-4ad6-b7c0-579c2c583096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d867d4df-9d60-4213-9895-3583d7914735", "tag": "f8ab8844-1efe-4e80-a575-5c63bfe8bdda"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:16:19.150823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:19.151613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:19.152306 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:19.153158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:19.153769 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:19.154494 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:19.155402 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-98de7a89-7cbb-4522-8bfe-b89397f3dea9 req-471106a6-4f54-4ad6-b7c0-579c2c583096 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:19.155886 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-98de7a89-7cbb-4522-8bfe-b89397f3dea9 req-471106a6-4f54-4ad6-b7c0-579c2c583096 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:19.156318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-98de7a89-7cbb-4522-8bfe-b89397f3dea9 req-471106a6-4f54-4ad6-b7c0-579c2c583096 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:19.167381 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-98de7a89-7cbb-4522-8bfe-b89397f3dea9 req-471106a6-4f54-4ad6-b7c0-579c2c583096 service nova] Creating event network-changed:f8ab8844-1efe-4e80-a575-5c63bfe8bdda for instance d867d4df-9d60-4213-9895-3583d7914735 on hv-cinder-85535 Sep 02 09:16:19.172590 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-98de7a89-7cbb-4522-8bfe-b89397f3dea9 req-471106a6-4f54-4ad6-b7c0-579c2c583096 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036258 Sep 02 09:16:19.173379 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 498/985] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:16:19.181217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:16:19.276719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e12049d1-6d29-4e1f-9b54-f60e9cb957cd tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 204 len: 0 microversion: 2.1 time: 0.142157 Sep 02 09:16:19.277308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 488/986] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:16:19 2022] DELETE /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:16:19.288246 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:19.288956 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:19.296242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:19.296663 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:19.297157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:19.297857 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:19.298316 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:19.298769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:19.438958 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:19.451352 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ef0aec9-f9ce-43db-bedd-48080e57288a tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.168695 Sep 02 09:16:19.451948 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 499/987] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:16:19 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:16:20.473153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:20.473853 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:20.480543 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:20.481044 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:20.481641 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:20.482351 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:20.483156 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:20.483698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:20.647200 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:20.656578 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-16d9aeb1-da09-4fe8-8c85-0b27b15088b5 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1566 microversion: 2.1 time: 0.188047 Sep 02 09:16:20.658047 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 489/988] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:16:20 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:16:21.679525 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:21.680363 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:21.686814 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:21.687335 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:21.687776 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:21.688547 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:21.689101 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:21.689529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:21.924454 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-d63ab1be-9aaa-4438-baae-8d9b03c6383c req-d6a3f1ad-cbc6-48b7-b924-1c6095c0725d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d867d4df-9d60-4213-9895-3583d7914735", "name": "network-vif-deleted", "tag": "f8ab8844-1efe-4e80-a575-5c63bfe8bdda"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:16:21.936036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d63ab1be-9aaa-4438-baae-8d9b03c6383c req-d6a3f1ad-cbc6-48b7-b924-1c6095c0725d service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:21.936504 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d63ab1be-9aaa-4438-baae-8d9b03c6383c req-d6a3f1ad-cbc6-48b7-b924-1c6095c0725d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:21.936931 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d63ab1be-9aaa-4438-baae-8d9b03c6383c req-d6a3f1ad-cbc6-48b7-b924-1c6095c0725d service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:21.937132 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd2f1b7788a4095a28f8fb6917c5705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81e4ab123d54ebdbf4165e250967df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:21.948185 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-d63ab1be-9aaa-4438-baae-8d9b03c6383c req-d6a3f1ad-cbc6-48b7-b924-1c6095c0725d service nova] Creating event network-vif-deleted:f8ab8844-1efe-4e80-a575-5c63bfe8bdda for instance d867d4df-9d60-4213-9895-3583d7914735 on hv-cinder-85535 Sep 02 09:16:21.952690 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04105e55-676d-4778-8ad4-99169d81e0a3 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 200 len: 1447 microversion: 2.1 time: 0.277762 Sep 02 09:16:21.953270 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 500/989] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:16:21 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 1447 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:16:21.953836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-d63ab1be-9aaa-4438-baae-8d9b03c6383c req-d6a3f1ad-cbc6-48b7-b924-1c6095c0725d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034531 Sep 02 09:16:21.954784 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 490/990] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:16:22.976694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:22.977406 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] [instance: d867d4df-9d60-4213-9895-3583d7914735] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:22.984895 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:22.985476 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:22.986226 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:22.987004 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:22.987624 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:22.988044 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:23.002648 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] HTTP exception thrown: Instance d867d4df-9d60-4213-9895-3583d7914735 could not be found. Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Request method failure captured: Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 HTTP/1.1 Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEciXgO1d3Lzw1PNIdxZsyHkJUSP7zZP4HdKnODvIj9O9bSR4WQmFjGU6MfmF_eRe4pgP0GA3UVpZr9ZsoTxErmEWFlhtMI8UxtUmzYXxzz1Phm2YbPAblaLc2nPnuc0XTomCWQdW-Tr6jLr6n64r072DMVjF8jR3Kxb_LBsLmh-1fz8 Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: d81e4ab123d54ebdbf4165e250967df6 Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestShelveInstance-1903345929 Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:16:23.004448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d81e4ab123d54ebdbf4165e250967df6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d81e4ab123d54ebdbf4165e250967df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d81e4ab123d54ebdbf4165e250967df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d81e4ab123d54ebdbf4165e250967df6", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestShelveInstance-1903345929 Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: d81e4ab123d54ebdbf4165e250967df6 Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestShelveInstance-1903345929 Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-TestShelveInstance-1903345929-project Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 0fd2f1b7788a4095a28f8fb6917c5705 Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestShelveInstance-1903345929-project Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance d867d4df-9d60-4213-9895-3583d7914735 could not be found. Sep 02 09:16:23.006190 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': 'd867d4df-9d60-4213-9895-3583d7914735'} Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d867d4df-9d60-4213-9895-3583d7914735 could not be found. Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:23.010347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d867d4df-9d60-4213-9895-3583d7914735 could not be found. Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d867d4df-9d60-4213-9895-3583d7914735 could not be found. Sep 02 09:16:23.011899 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:23.013909 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Returning 404 to user: Instance d867d4df-9d60-4213-9895-3583d7914735 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:23.013909 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bd1a3bd2-4b21-42e2-ac79-440a03bc6fbe tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735" status: 404 len: 111 microversion: 2.1 time: 0.033963 Sep 02 09:16:23.013909 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 501/991] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:16:22 2022] GET /compute/v2.1/servers/d867d4df-9d60-4213-9895-3583d7914735 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:16:23.169768 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fffc2835-484d-4c9f-855f-31aa42fe1206 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] Calling method '.version_select at 0x7f54bc4cd430>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:23.196254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fffc2835-484d-4c9f-855f-31aa42fe1206 tempest-TestShelveInstance-1903345929 tempest-TestShelveInstance-1903345929-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-343451252" status: 202 len: 0 microversion: 2.1 time: 0.031127 Sep 02 09:16:23.200561 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 491/992] 10.222.0.36 () {58 vars in 1251 bytes} [Fri Sep 2 09:16:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-343451252 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:16:29.905036 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ab8e822b-bad6-4c00-8b3b-041d864c7433 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:29.907318 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ab8e822b-bad6-4c00-8b3b-041d864c7433 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:29.913501 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab8e822b-bad6-4c00-8b3b-041d864c7433 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:29.913975 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab8e822b-bad6-4c00-8b3b-041d864c7433 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:29.914399 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab8e822b-bad6-4c00-8b3b-041d864c7433 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:29.915309 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab8e822b-bad6-4c00-8b3b-041d864c7433 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:29.915763 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab8e822b-bad6-4c00-8b3b-041d864c7433 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:29.916180 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab8e822b-bad6-4c00-8b3b-041d864c7433 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:29.948200 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ab8e822b-bad6-4c00-8b3b-041d864c7433 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046945 Sep 02 09:16:29.948744 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 502/993] 10.222.0.36 () {60 vars in 1343 bytes} [Fri Sep 2 09:16:29 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:16:30.015811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:30.016478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:30.026228 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:30.026743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:30.027246 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:30.028191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:30.028937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:30.030177 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:30.056230 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:16:30.143529 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8c8c14e0-8894-49ec-9449-66ee2b92e99a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 204 len: 0 microversion: 2.20 time: 0.132074 Sep 02 09:16:30.144334 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 492/994] 10.222.0.36 () {60 vars in 1280 bytes} [Fri Sep 2 09:16:30 2022] DELETE /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 09:16:30.154086 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:30.154694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:30.160794 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:30.161277 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:30.161705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:30.162391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:30.162840 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:30.163284 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:30.317695 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:30.325802 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:30.327462 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:30.329030 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1df13121-b9bf-42f1-a563-4706eb8b300e tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.178842 Sep 02 09:16:30.329591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 503/995] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:16:30 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:16:31.355852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:31.357196 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:31.364727 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:31.365210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:31.365644 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:31.366339 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:31.366790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:31.367241 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:31.495415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:31.504661 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:31.506091 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:31.507273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a1ee5345-4806-43fe-a56a-d452289697f1 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1723 microversion: 2.20 time: 0.155695 Sep 02 09:16:31.507839 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 493/996] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:16:31 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:16:32.530127 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:32.530745 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:32.538107 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:32.538601 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:32.539096 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:32.539821 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:32.540434 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:32.540729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:32.733922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:32.743630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:32.745201 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10fcb673c54e484a88a0dabe7b8edb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03f09713c2e45d9a261416a5dbd0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:16:32.746754 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b907b3ad-70cb-4302-bf4b-c4e60b73bd05 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 200 len: 1655 microversion: 2.20 time: 0.220820 Sep 02 09:16:32.747669 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 504/997] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:16:32 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 1655 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:16:32.914364 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-934c91e1-1af7-46a9-87cb-867f53ce1613 req-e2f5f400-14f9-4206-82aa-b2d679d535d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde844d8-53ed-4ac1-813f-80203a754084", "name": "network-vif-deleted", "tag": "d6bad915-ef87-444d-aa2b-102e8e9b311d"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:16:32.925967 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-934c91e1-1af7-46a9-87cb-867f53ce1613 req-e2f5f400-14f9-4206-82aa-b2d679d535d1 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:32.926482 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-934c91e1-1af7-46a9-87cb-867f53ce1613 req-e2f5f400-14f9-4206-82aa-b2d679d535d1 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:32.926894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-934c91e1-1af7-46a9-87cb-867f53ce1613 req-e2f5f400-14f9-4206-82aa-b2d679d535d1 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:32.941919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-934c91e1-1af7-46a9-87cb-867f53ce1613 req-e2f5f400-14f9-4206-82aa-b2d679d535d1 service nova] Creating event network-vif-deleted:d6bad915-ef87-444d-aa2b-102e8e9b311d for instance dde844d8-53ed-4ac1-813f-80203a754084 on hv-cinder-85535 Sep 02 09:16:32.948183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-934c91e1-1af7-46a9-87cb-867f53ce1613 req-e2f5f400-14f9-4206-82aa-b2d679d535d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037121 Sep 02 09:16:32.948779 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 494/998] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:16:33.770250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:33.770949 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:33.777455 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:33.778139 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:33.778573 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:33.779292 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:33.779791 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:33.780212 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:33.794896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] HTTP exception thrown: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Request method failure captured: Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 HTTP/1.1 Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgervgtx3-xa1JOOYa0SUQUztnVqJGlBd9J7kgpgeshuLR_549po5peVWxYPvf0tB5cEnlJq9rQmF7exnuEuLZTVzdHMZ1y4U4CzVIoK5Foe3v5R8WLTF7DyvbG9x4ufIKIQEKtbPX0WPBF39WuH8WZYS7V9HsdDWU1ievj4QuULm8 Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:16:33.796474 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03f09713c2e45d9a261416a5dbd0883", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 10fcb673c54e484a88a0dabe7b8edb15 Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:33.798311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': 'dde844d8-53ed-4ac1-813f-80203a754084'} Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:33.799294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:33.800829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:33.802592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Returning 404 to user: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:33.802592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-61bed455-5ca2-4316-8e6b-456cc958080c tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 404 len: 111 microversion: 2.20 time: 0.032062 Sep 02 09:16:33.802592 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 505/999] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:16:33 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:16:33.808389 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b14ffe2d-8889-40d2-95af-e33337f042f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '.version_select at 0x7f54bc6a2280>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:33.826950 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b14ffe2d-8889-40d2-95af-e33337f042f8 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341972648" status: 204 len: 0 microversion: 2.20 time: 0.022714 Sep 02 09:16:33.827721 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 495/1000] 10.222.0.36 () {60 vars in 1262 bytes} [Fri Sep 2 09:16:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341972648 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 09:16:35.568797 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:35.569344 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:35.575641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:35.576119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:35.576546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:35.577230 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:35.577680 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:35.578096 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:35.591661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] HTTP exception thrown: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Request method failure captured: Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 HTTP/1.1 Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgervgtx3-xa1JOOYa0SUQUztnVqJGlBd9J7kgpgeshuLR_549po5peVWxYPvf0tB5cEnlJq9rQmF7exnuEuLZTVzdHMZ1y4U4CzVIoK5Foe3v5R8WLTF7DyvbG9x4ufIKIQEKtbPX0WPBF39WuH8WZYS7V9HsdDWU1ievj4QuULm8 Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:16:35.593221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03f09713c2e45d9a261416a5dbd0883", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 10fcb673c54e484a88a0dabe7b8edb15 Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.594870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': 'dde844d8-53ed-4ac1-813f-80203a754084'} Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:35.595753 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.597536 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.598786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Returning 404 to user: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:35.598786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5d78474f-251e-409f-adbb-0842d8403f29 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 404 len: 111 microversion: 2.20 time: 0.030621 Sep 02 09:16:35.598786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 506/1001] 10.222.0.36 () {60 vars in 1280 bytes} [Fri Sep 2 09:16:35 2022] DELETE /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:16:35.604415 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:35.605169 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: dde844d8-53ed-4ac1-813f-80203a754084] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:35.611147 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:35.611826 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:35.613065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:35.613765 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:35.614223 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:35.614651 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:35.628219 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] HTTP exception thrown: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Request method failure captured: Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 HTTP/1.1 Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgervgtx3-xa1JOOYa0SUQUztnVqJGlBd9J7kgpgeshuLR_549po5peVWxYPvf0tB5cEnlJq9rQmF7exnuEuLZTVzdHMZ1y4U4CzVIoK5Foe3v5R8WLTF7DyvbG9x4ufIKIQEKtbPX0WPBF39WuH8WZYS7V9HsdDWU1ievj4QuULm8 Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:16:35.629854 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03f09713c2e45d9a261416a5dbd0883", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 10fcb673c54e484a88a0dabe7b8edb15 Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.631493 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': 'dde844d8-53ed-4ac1-813f-80203a754084'} Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:35.632385 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. Sep 02 09:16:35.633833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:35.635387 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Returning 404 to user: Instance dde844d8-53ed-4ac1-813f-80203a754084 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:35.635387 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14248d99-fdd2-4a2a-8369-2ede440ac89a tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084" status: 404 len: 111 microversion: 2.20 time: 0.031074 Sep 02 09:16:35.635387 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 496/1002] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:16:35 2022] GET /compute/v2.1/servers/dde844d8-53ed-4ac1-813f-80203a754084 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:16:36.767829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:36.768904 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:36.775492 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:36.775976 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:36.776406 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:36.777093 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:36.777542 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:36.777960 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:36.791856 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] HTTP exception thrown: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Request method failure captured: Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 HTTP/1.1 Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcgervgtx3-xa1JOOYa0SUQUztnVqJGlBd9J7kgpgeshuLR_549po5peVWxYPvf0tB5cEnlJq9rQmF7exnuEuLZTVzdHMZ1y4U4CzVIoK5Foe3v5R8WLTF7DyvbG9x4ufIKIQEKtbPX0WPBF39WuH8WZYS7V9HsdDWU1ievj4QuULm8 Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:16:36.793428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03f09713c2e45d9a261416a5dbd0883", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 10fcb673c54e484a88a0dabe7b8edb15 Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.795034 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': '5d6b1337-6402-4108-aef8-2ad90760a201'} Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:36.795881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.797134 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.798896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Returning 404 to user: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:36.798896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f36722a2-c9e4-4f55-a95c-1b52b0acf1b3 tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 404 len: 111 microversion: 2.20 time: 0.031190 Sep 02 09:16:36.798896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 507/1003] 10.222.0.36 () {60 vars in 1280 bytes} [Fri Sep 2 09:16:36 2022] DELETE /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:16:36.803732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:16:36.804348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] [instance: 5d6b1337-6402-4108-aef8-2ad90760a201] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:16:36.810926 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:36.811432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:36.811862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:36.812551 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:16:36.813001 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:16:36.813422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:16:36.826882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] HTTP exception thrown: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Request method failure captured: Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 HTTP/1.1 Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcgervgtx3-xa1JOOYa0SUQUztnVqJGlBd9J7kgpgeshuLR_549po5peVWxYPvf0tB5cEnlJq9rQmF7exnuEuLZTVzdHMZ1y4U4CzVIoK5Foe3v5R8WLTF7DyvbG9x4ufIKIQEKtbPX0WPBF39WuH8WZYS7V9HsdDWU1ievj4QuULm8 Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:16:36.828428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03f09713c2e45d9a261416a5dbd0883"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03f09713c2e45d9a261416a5dbd0883", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: e03f09713c2e45d9a261416a5dbd0883 Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103442115 Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 10fcb673c54e484a88a0dabe7b8edb15 Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103442115-project Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.830124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '5d6b1337-6402-4108-aef8-2ad90760a201'} Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:16:36.831719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. Sep 02 09:16:36.833442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:16:36.834953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] Returning 404 to user: Instance 5d6b1337-6402-4108-aef8-2ad90760a201 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:16:36.834953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0b77d24c-3927-47e3-9dc7-b8dd5af3c4bc tempest-AttachVolumeShelveTestJSON-103442115 tempest-AttachVolumeShelveTestJSON-103442115-project] 10.222.0.36 "GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201" status: 404 len: 111 microversion: 2.20 time: 0.029979 Sep 02 09:16:36.834953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 497/1004] 10.222.0.36 () {60 vars in 1277 bytes} [Fri Sep 2 09:16:36 2022] GET /compute/v2.1/servers/5d6b1337-6402-4108-aef8-2ad90760a201 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:17:22.818328 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=20 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:22.820735 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=40 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:23.090002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5022dbc9-4efe-40f6-bc96-6daf02901948 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Action: 'create', calling method: .version_select at 0x7f54bc656a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1541286053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3c8B9Zb6lss3uB6nsG+7tFuSVg5wk/7NK1hMVscBXQ640eLKvpg1LeVEW9wJ/7HKU4349HHPwrGBHgFdrk/xkP6uPw3vOFkXx4iYIWz+fUVfbW/lJ2xpa11CH451ZrgQ=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:17:23.134440 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5022dbc9-4efe-40f6-bc96-6daf02901948 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Getting quotas for project a09b3fcd4fdc424086b7ca6b15d0a4e9. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:17:23.142296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5022dbc9-4efe-40f6-bc96-6daf02901948 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Getting quotas for user 7e1f6e80465a44d0a90200ada3f43e23 and project a09b3fcd4fdc424086b7ca6b15d0a4e9. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:17:23.177144 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5022dbc9-4efe-40f6-bc96-6daf02901948 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.364701 Sep 02 09:17:23.178704 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 508/1005] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:17:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:17:42.875802 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:42.876742 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:42.882097 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1291754775", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1541286053", "security_groups": [{"name": "tempest-secgroup-smoke-385705346"}], "block_device_mapping_v2": [{"uuid": "064179a4-6996-4c21-94cd-0cc8c5da492c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ad15bb0-c129-4f42-a06e-290f3ce89bff"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:17:43.062729 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] validate_networks() for [('9ad15bb0-c129-4f42-a06e-290f3ce89bff', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:17:43.845107 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:17:43.846044 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:17:43.846998 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:17:43.847471 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:17:43.847894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:17:43.857867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:43.858566 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:43.859011 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:43.865185 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:43.865821 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:43.866313 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:43.889082 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Getting quotas for project a09b3fcd4fdc424086b7ca6b15d0a4e9. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:17:43.893075 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Getting quotas for user 7e1f6e80465a44d0a90200ada3f43e23 and project a09b3fcd4fdc424086b7ca6b15d0a4e9. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:17:43.956770 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:17:43.960176 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='064179a4-6996-4c21-94cd-0cc8c5da492c',volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:17:44.155843 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fb24178a-eee6-444c-bcba-5c2af979a3c1 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.282026 Sep 02 09:17:44.162909 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 498/1006] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:17:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 09:17:44.168103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:44.169774 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:44.174990 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7ac437d4-361e-40dd-8495-a5326cbf08e0 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:44.176073 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7ac437d4-361e-40dd-8495-a5326cbf08e0 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:44.251528 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7ac437d4-361e-40dd-8495-a5326cbf08e0 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:44.260389 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7ac437d4-361e-40dd-8495-a5326cbf08e0 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1095 microversion: 2.1 time: 0.094687 Sep 02 09:17:44.262922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 509/1007] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:44 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1095 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:45.283849 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:45.285153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:45.293250 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:45.293919 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:45.294358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:45.295774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:45.296571 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:45.297148 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:45.377697 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:45.386528 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-042856ef-a627-4863-8c9b-318b81b7a61f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1193 microversion: 2.1 time: 0.108281 Sep 02 09:17:45.387621 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 499/1008] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:45 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:46.408726 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:46.409329 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:46.419415 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:46.420221 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:46.421011 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:46.422006 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:46.422957 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:46.423561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:46.509215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:46.520713 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6165de2-e3bf-4826-821f-661ad7413734 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1211 microversion: 2.1 time: 0.115547 Sep 02 09:17:46.521509 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 510/1009] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:46 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:47.543709 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:47.544324 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:47.550636 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:47.551314 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:47.551945 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:47.552819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:47.553564 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:47.553992 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:47.946474 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:47.956775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c0f3de9f-1f8c-4cbd-8fb2-7e297e3e3c96 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.417778 Sep 02 09:17:47.958343 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 500/1010] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:47 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:48.884809 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-12032a2e-faf1-4449-ab42-00d771cca363 req-92428786-e33f-4430-b871-ffeda185f06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a", "tag": "a49cb379-757d-43a1-a4a1-d6366ca61c54"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:17:48.921634 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-12032a2e-faf1-4449-ab42-00d771cca363 req-92428786-e33f-4430-b871-ffeda185f06c service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:48.922111 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-12032a2e-faf1-4449-ab42-00d771cca363 req-92428786-e33f-4430-b871-ffeda185f06c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:48.922935 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-12032a2e-faf1-4449-ab42-00d771cca363 req-92428786-e33f-4430-b871-ffeda185f06c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:48.944362 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-12032a2e-faf1-4449-ab42-00d771cca363 req-92428786-e33f-4430-b871-ffeda185f06c service nova] Creating event network-changed:a49cb379-757d-43a1-a4a1-d6366ca61c54 for instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a on hv-cinder-85535 Sep 02 09:17:48.951002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-12032a2e-faf1-4449-ab42-00d771cca363 req-92428786-e33f-4430-b871-ffeda185f06c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075844 Sep 02 09:17:48.951930 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 511/1011] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:17:48.979774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:48.981235 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:48.996533 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:48.997414 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:48.998046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:48.999102 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:48.999882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:49.001907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:49.304587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:49.312308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cf5cc611-aae4-4268-a537-a478c2991c7d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.336610 Sep 02 09:17:49.326633 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 501/1012] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:48 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:50.342707 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:50.348762 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:50.360026 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:50.360742 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:50.361395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:50.362303 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:50.362916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:50.363712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:50.562468 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:50.572533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c6cb9d47-c4cc-463d-b3aa-2941c024b4db tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.234498 Sep 02 09:17:50.573117 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 512/1013] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:50 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:51.593791 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:51.594580 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:51.601458 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:51.602193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:51.602839 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:51.603754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:51.604479 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:51.605116 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:51.774609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:51.783991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ec8f0ba4-80ac-49d4-8f7d-b3a3d344f683 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.194034 Sep 02 09:17:51.797536 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 502/1014] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:51 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:52.805263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:52.808926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:52.818732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:52.820086 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:52.821100 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:52.821812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:52.822931 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:52.823387 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:53.014824 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:53.025133 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2961bed6-651f-4958-8dfe-adf23b328b88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.224009 Sep 02 09:17:53.026392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 513/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:52 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:54.045804 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:54.047055 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:54.051447 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:54.076462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:54.083696 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:54.084235 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:54.084679 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:54.085643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:54.086106 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:54.086541 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:54.250240 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:54.258911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-738c1ea3-0c50-4a1b-bf58-598ee73225cf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.216918 Sep 02 09:17:54.259501 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 503/1016] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:54 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:55.280400 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:55.281575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:55.289234 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:17:55.290664 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:55.291173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:55.291828 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:55.295092 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:55.295943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:55.296597 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:55.444329 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:55.452330 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ad792e98-ff77-4e07-941c-2424cc15735f tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.175898 Sep 02 09:17:55.452911 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 514/1017] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:55 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:56.473465 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:56.474794 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:56.481233 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:56.481928 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:56.485040 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:56.485799 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:56.486281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:56.486697 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:56.638407 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:56.647653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b352f174-bc1a-40cd-bef6-4587c6a1ac52 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.177812 Sep 02 09:17:56.648897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 504/1018] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:56 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:57.668127 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:57.668722 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:57.675482 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:57.676195 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:57.676607 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:57.677480 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:57.678091 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:57.678521 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:57.854556 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:57.862569 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-70271e07-eb95-474b-a966-37a000f9218b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.198246 Sep 02 09:17:57.863505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 515/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:57 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:58.888957 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:17:58.890352 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:17:58.907005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:58.907005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:58.907005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:58.907005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:58.907539 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:58.907539 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:59.056158 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:17:59.080966 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6b9fe7b6-c1f2-4ae2-967c-814ef7630a34 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.200329 Sep 02 09:17:59.081827 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 505/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:17:58 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:17:59.443403 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3b3d57a0-81f3-45be-b682-e88ed35961d5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Action: 'create', calling method: .version_select at 0x7f54bc617700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-513916534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9+aaJ0hcb8fbNINx/uWxbeKGyK3dHWum7jaFcjspJLczvh5jZsqm7LloGEAfeizvNfYqNTAgOBFTGNueKfLk7Jk493M/HUFBd1QfMhYt+PiOodrZ5QLYasLObvYrbqdA=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:17:59.459058 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-3b3d57a0-81f3-45be-b682-e88ed35961d5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Getting quotas for project b133928ce6ac4acaa1b0c224909c76fd. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:17:59.463137 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-3b3d57a0-81f3-45be-b682-e88ed35961d5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Getting quotas for user fa92771235f04c668690cd05d4a2b44c and project b133928ce6ac4acaa1b0c224909c76fd. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:17:59.483903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3b3d57a0-81f3-45be-b682-e88ed35961d5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045141 Sep 02 09:17:59.484503 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 516/1021] 10.222.0.36 () {60 vars in 1159 bytes} [Fri Sep 2 09:17:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:17:59.535913 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1797848050", "imageRef": "596bc0b5-f9ba-44eb-aa98-edcee56d07a2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-513916534", "networks": [{"uuid": "b4edb97e-ca44-4230-8b37-446a7aa11029"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:17:59.586796 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] validate_networks() for [('b4edb97e-ca44-4230-8b37-446a7aa11029', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:17:59.911666 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-5d9f0c45-8c21-460d-a691-a46332d1dccd req-a4cdb46c-1928-49fb-b0cf-6e69d84da72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a", "name": "network-vif-plugged", "status": "completed", "tag": "a49cb379-757d-43a1-a4a1-d6366ca61c54"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:17:59.923648 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-5d9f0c45-8c21-460d-a691-a46332d1dccd req-a4cdb46c-1928-49fb-b0cf-6e69d84da72b service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:59.924341 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-5d9f0c45-8c21-460d-a691-a46332d1dccd req-a4cdb46c-1928-49fb-b0cf-6e69d84da72b service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:59.924974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-5d9f0c45-8c21-460d-a691-a46332d1dccd req-a4cdb46c-1928-49fb-b0cf-6e69d84da72b service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:59.936912 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-5d9f0c45-8c21-460d-a691-a46332d1dccd req-a4cdb46c-1928-49fb-b0cf-6e69d84da72b service nova] Creating event network-vif-plugged:a49cb379-757d-43a1-a4a1-d6366ca61c54 for instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a on hv-cinder-85535 Sep 02 09:17:59.942636 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-5d9f0c45-8c21-460d-a691-a46332d1dccd req-a4cdb46c-1928-49fb-b0cf-6e69d84da72b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035923 Sep 02 09:17:59.943357 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 517/1022] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:17:59.963124 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:17:59.963637 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:17:59.964013 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:17:59.964422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:17:59.965009 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:17:59.974548 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:59.975141 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:59.975612 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:59.976336 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:17:59.976823 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:17:59.977811 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:17:59.995696 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Getting quotas for project b133928ce6ac4acaa1b0c224909c76fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:18:00.000062 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Getting quotas for user fa92771235f04c668690cd05d4a2b44c and project b133928ce6ac4acaa1b0c224909c76fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:18:00.011502 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:18:00.013568 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='596bc0b5-f9ba-44eb-aa98-edcee56d07a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:18:00.061963 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4a72b375-fd89-4727-b5bc-39e44b7fd6da tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529641 Sep 02 09:18:00.062778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 506/1023] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:17:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:18:00.074444 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-00aaf3cd-a5e4-4fac-8e9a-a8da46261a12 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:00.075189 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-00aaf3cd-a5e4-4fac-8e9a-a8da46261a12 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:00.106743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:00.108196 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:00.117855 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:00.118642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:00.119339 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:00.120202 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:00.120974 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:00.121613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:00.135760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-00aaf3cd-a5e4-4fac-8e9a-a8da46261a12 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:00.145429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-00aaf3cd-a5e4-4fac-8e9a-a8da46261a12 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1258 microversion: 2.1 time: 0.075912 Sep 02 09:18:00.146546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 518/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:00 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:00.328200 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:00.336523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-61f6445c-3e9a-49a7-af57-9871efdf03ff tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1266 microversion: 2.1 time: 0.237314 Sep 02 09:18:00.337447 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 507/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:00 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:01.166215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:01.166826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:01.172793 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:01.173274 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:01.173697 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:01.174376 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:01.174822 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:01.175274 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:01.236941 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:01.245046 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-710315dd-155d-4601-bbfc-d37055fff478 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1310 microversion: 2.1 time: 0.082844 Sep 02 09:18:01.245609 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 519/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:01 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:01.357113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:01.357736 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:01.364808 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:01.365291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:01.365779 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:01.366418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:01.366875 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:01.367328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:01.495293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:01.502875 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08237014-0207-4281-bd8d-96b541287094 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1454 microversion: 2.1 time: 0.149763 Sep 02 09:18:01.503472 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 508/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:01 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:01.522532 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:01.523174 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:01.528970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:01.529454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:01.529894 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:01.530579 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:01.531035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:01.531488 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:01.932843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:01.940528 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-380c60ac-2f22-4744-ac41-61f2afcaebaf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1454 microversion: 2.1 time: 0.421758 Sep 02 09:18:01.941110 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 520/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:01 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1454 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:02.266408 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:02.267316 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:02.276322 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:02.276982 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:02.277570 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:02.278798 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:02.279478 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:02.280098 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:02.368323 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:02.380869 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4897eab4-b107-46a3-aa03-1288cd11b6cb tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1316 microversion: 2.1 time: 0.118233 Sep 02 09:18:02.382473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 509/1029] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:02 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1316 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:03.410327 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:03.412234 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:03.445490 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:03.446454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:03.447196 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:03.448216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:03.448869 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:03.449526 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:03.666407 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:03.676705 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-89f6bb46-76da-44c2-bafa-531a31f90813 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.276764 Sep 02 09:18:03.677547 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 521/1030] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:03 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:04.029358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-06d96339-2935-4191-9ee0-846a60a71a3f req-d9b711d9-a95a-4e76-8677-0acd61500196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a", "tag": "a49cb379-757d-43a1-a4a1-d6366ca61c54"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:18:04.043573 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-06d96339-2935-4191-9ee0-846a60a71a3f req-d9b711d9-a95a-4e76-8677-0acd61500196 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:04.044321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-06d96339-2935-4191-9ee0-846a60a71a3f req-d9b711d9-a95a-4e76-8677-0acd61500196 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:04.044918 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-06d96339-2935-4191-9ee0-846a60a71a3f req-d9b711d9-a95a-4e76-8677-0acd61500196 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:04.069547 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-06d96339-2935-4191-9ee0-846a60a71a3f req-d9b711d9-a95a-4e76-8677-0acd61500196 service nova] Creating event network-changed:a49cb379-757d-43a1-a4a1-d6366ca61c54 for instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a on hv-cinder-85535 Sep 02 09:18:04.075443 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-06d96339-2935-4191-9ee0-846a60a71a3f req-d9b711d9-a95a-4e76-8677-0acd61500196 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049654 Sep 02 09:18:04.076567 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 510/1031] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:18:04.702141 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:04.702771 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:04.709756 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:04.710769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:04.711479 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:04.712406 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:04.713062 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:04.713847 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:04.870127 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:04.884874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66425e1b-4761-420d-94ca-2813735fafe0 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.186865 Sep 02 09:18:04.893692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 522/1032] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:04 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:05.906882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:05.907667 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:05.914816 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:05.915441 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:05.915967 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:05.916889 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:05.917477 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:05.918004 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:06.059468 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:06.068504 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-35fb33b3-ca62-4f4c-91f2-95aca7520563 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.166424 Sep 02 09:18:06.069078 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 511/1033] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:05 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:07.089743 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:07.090270 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:07.096781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:07.097271 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:07.097709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:07.099012 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:07.099500 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:07.099928 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:07.239984 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:07.249203 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2d6f3389-b85e-451e-a4e8-0ab5fa8ad7ce tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.163298 Sep 02 09:18:07.250489 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 523/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:07 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:08.270375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:08.270997 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:08.277878 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:08.278437 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:08.278897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:08.279677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:08.280177 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:08.280614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:08.425648 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:08.435895 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5bb05a15-1c31-42d1-bf7e-10bacaf70cf7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.169882 Sep 02 09:18:08.436483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 512/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:08 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:09.456784 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:09.457440 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:09.464716 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:09.465107 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:09.465542 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:09.466239 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:09.466694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:09.467144 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:09.609341 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:09.617643 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e8ed187f-a9a9-4457-a4b4-af5f47563112 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.164830 Sep 02 09:18:09.628391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 524/1036] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:09 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:10.637665 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:10.638283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:10.640706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:10.641517 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:10.647707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:10.648192 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:10.648624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:10.649321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:10.649770 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:10.650193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:10.945958 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:10.953512 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3f942d43-bcda-48b1-bd8a-97ac0ac677cd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.319680 Sep 02 09:18:10.954285 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 513/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:10 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:11.382216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-7b9194df-a1cc-47d5-af11-c9bcfd88cccc req-8cae8ada-09b2-490c-9cef-771e9a00819e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2", "tag": "25350c4b-3e48-496c-9881-13794cda12d0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:18:11.387189 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:11.393441 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7b9194df-a1cc-47d5-af11-c9bcfd88cccc req-8cae8ada-09b2-490c-9cef-771e9a00819e service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:11.393920 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7b9194df-a1cc-47d5-af11-c9bcfd88cccc req-8cae8ada-09b2-490c-9cef-771e9a00819e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:11.394345 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7b9194df-a1cc-47d5-af11-c9bcfd88cccc req-8cae8ada-09b2-490c-9cef-771e9a00819e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:11.406031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-7b9194df-a1cc-47d5-af11-c9bcfd88cccc req-8cae8ada-09b2-490c-9cef-771e9a00819e service nova] Creating event network-changed:25350c4b-3e48-496c-9881-13794cda12d0 for instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 on hv-cinder-85535 Sep 02 09:18:11.411082 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-7b9194df-a1cc-47d5-af11-c9bcfd88cccc req-8cae8ada-09b2-490c-9cef-771e9a00819e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033124 Sep 02 09:18:11.411712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 525/1038] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:18:11.973800 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:11.974419 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:11.980706 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:11.981184 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:11.981617 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:11.982321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:11.982772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:11.983222 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:12.106575 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:12.114708 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-19b9e31a-a43f-41e7-8efe-46760afb50e1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.145308 Sep 02 09:18:12.115309 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 514/1039] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:11 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:13.136751 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:13.137481 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:13.143495 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:13.143912 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:13.144344 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:13.145055 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:13.145537 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:13.145956 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:13.275368 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:13.282896 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a7cc92fa-df91-4c8a-b0a2-36ed367c451a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.150841 Sep 02 09:18:13.284121 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 526/1040] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:13 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:14.304432 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:14.305719 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:14.308357 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:14.313625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:14.314110 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:14.314551 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:14.315287 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:14.315752 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:14.316213 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:14.320063 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=91 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:14.452648 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:14.460668 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bc7e0aaa-4558-4d8b-86a7-e133022468c7 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.159896 Sep 02 09:18:14.461483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 515/1041] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:14 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:15.481847 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:15.482465 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:15.484879 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:15.490412 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:15.490949 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:15.491365 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:15.492055 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:15.492513 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:15.492938 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:15.497662 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=79 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:15.620187 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:15.627709 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-94582baf-5791-414c-b3c6-4ebc895a5577 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.149791 Sep 02 09:18:15.628280 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 527/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:15 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:16.085312 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-272d554a-9217-40b0-84c8-54c8b6ebb991 req-df7c96a0-468b-47aa-a9c8-140d159973a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2", "name": "network-vif-plugged", "status": "completed", "tag": "25350c4b-3e48-496c-9881-13794cda12d0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:18:16.095571 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-272d554a-9217-40b0-84c8-54c8b6ebb991 req-df7c96a0-468b-47aa-a9c8-140d159973a5 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:16.096227 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-272d554a-9217-40b0-84c8-54c8b6ebb991 req-df7c96a0-468b-47aa-a9c8-140d159973a5 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:16.096663 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-272d554a-9217-40b0-84c8-54c8b6ebb991 req-df7c96a0-468b-47aa-a9c8-140d159973a5 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:16.108145 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-272d554a-9217-40b0-84c8-54c8b6ebb991 req-df7c96a0-468b-47aa-a9c8-140d159973a5 service nova] Creating event network-vif-plugged:25350c4b-3e48-496c-9881-13794cda12d0 for instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 on hv-cinder-85535 Sep 02 09:18:16.113140 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-272d554a-9217-40b0-84c8-54c8b6ebb991 req-df7c96a0-468b-47aa-a9c8-140d159973a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031557 Sep 02 09:18:16.113757 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 516/1043] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:18:16.648684 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:16.649296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:16.655659 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:16.656143 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:16.656576 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:16.657274 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:16.657732 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:16.658157 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:16.782260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:16.789783 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-960bd562-bfe8-4183-b143-4e6face8ceff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1358 microversion: 2.1 time: 0.144979 Sep 02 09:18:16.790348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 528/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:16 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:18:17.812193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:17.812906 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:17.819521 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:17.820010 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:17.820449 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:17.821144 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:17.821603 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:17.822034 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:17.947466 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:17.955000 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f54831c6-17e3-427f-bca0-0ede577901ed tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1548 microversion: 2.1 time: 0.148890 Sep 02 09:18:17.955588 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 517/1045] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:17 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:17.975534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:17.976158 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:17.982472 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:17.982960 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:17.983444 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:17.984140 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:17.984602 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:17.985031 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:18.111227 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:18.119249 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ae78b416-5355-4b84-8c6f-1719990ed278 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1548 microversion: 2.1 time: 0.147567 Sep 02 09:18:18.119815 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 529/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:17 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:18.139491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:18.144475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:18.145247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Searching by: {'deleted': False, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd'} {{(pid=120572) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 02 09:18:18.151833 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:18.152316 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:18.152752 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:18.153475 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:18.153930 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:18.154355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:18.242438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.multi_cell_list [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120572) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 02 09:18:18.333917 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b202af3a-d9ad-43f4-98e3-7715cd499e26 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198086 Sep 02 09:18:18.334418 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 518/1047] 10.222.0.36 () {58 vars in 1125 bytes} [Fri Sep 2 09:18:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:18:18.346060 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:18.346673 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:18.352537 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:18.353017 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:18.353450 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:18.354136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:18.354588 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:18.355005 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:18.480350 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:18.488002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-09ecb105-b902-4ed5-9a6d-dc6991f6d1f2 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1548 microversion: 2.1 time: 0.145971 Sep 02 09:18:18.488575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 530/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:18 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:20.010355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-81e21701-7165-432c-ba33-3e8d291b3a10 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7ace4fd-3b17-40ad-b297-76f6da4206fb"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:18:20.012689 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-81e21701-7165-432c-ba33-3e8d291b3a10 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:20.018888 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81e21701-7165-432c-ba33-3e8d291b3a10 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:20.019402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81e21701-7165-432c-ba33-3e8d291b3a10 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:20.019839 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81e21701-7165-432c-ba33-3e8d291b3a10 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:20.020526 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81e21701-7165-432c-ba33-3e8d291b3a10 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:20.020978 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81e21701-7165-432c-ba33-3e8d291b3a10 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:20.021399 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81e21701-7165-432c-ba33-3e8d291b3a10 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:20.271457 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-81e21701-7165-432c-ba33-3e8d291b3a10 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "POST /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265267 Sep 02 09:18:20.272065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 519/1049] 10.222.0.36 () {60 vars in 1323 bytes} [Fri Sep 2 09:18:20 2022] POST /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:18:27.832786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:27.833401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:27.840677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:27.841166 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:27.841603 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:27.842294 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:27.842751 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:27.843210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:27.980756 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:27.988945 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d340d905-0ff5-4997-ab23-a5460e9dc59f tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1594 microversion: 2.1 time: 0.159918 Sep 02 09:18:27.989517 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 531/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:27 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:29.840953 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-25cfe95f-7212-4f30-8bb7-c696904ee56c req-a23980ed-6911-4e37-8f15-b062fa2e0edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2", "tag": "25350c4b-3e48-496c-9881-13794cda12d0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:18:29.847567 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:29.852171 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-25cfe95f-7212-4f30-8bb7-c696904ee56c req-a23980ed-6911-4e37-8f15-b062fa2e0edb service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:29.852639 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-25cfe95f-7212-4f30-8bb7-c696904ee56c req-a23980ed-6911-4e37-8f15-b062fa2e0edb service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:29.853155 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-25cfe95f-7212-4f30-8bb7-c696904ee56c req-a23980ed-6911-4e37-8f15-b062fa2e0edb service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:29.864725 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-25cfe95f-7212-4f30-8bb7-c696904ee56c req-a23980ed-6911-4e37-8f15-b062fa2e0edb service nova] Creating event network-changed:25350c4b-3e48-496c-9881-13794cda12d0 for instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 on hv-cinder-85535 Sep 02 09:18:29.869755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-25cfe95f-7212-4f30-8bb7-c696904ee56c req-a23980ed-6911-4e37-8f15-b062fa2e0edb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032890 Sep 02 09:18:29.870355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 520/1051] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:18:30.962043 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2086108602"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:18:30.962587 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:30.968425 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:30.968916 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:30.969350 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:30.970032 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:30.970489 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:30.970913 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:31.093377 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.network.security_group_api [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Adding security group f397615a-7c9e-463b-8765-e4d9ab5055d0 to port 25350c4b-3e48-496c-9881-13794cda12d0 Sep 02 09:18:31.397348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aab086b2-7500-4040-86bc-b6d1714ba700 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "POST /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/action" status: 202 len: 0 microversion: 2.1 time: 0.439679 Sep 02 09:18:31.397962 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 532/1052] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:18:30 2022] POST /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 09:18:31.407295 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:31.407998 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:31.414460 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:31.414932 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:31.415388 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:31.416075 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:31.416524 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:31.416939 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:31.563041 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:31.571950 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-970aace3-ef74-4343-9233-9ae27b5e2f2d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1759 microversion: 2.1 time: 0.169386 Sep 02 09:18:31.573169 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 521/1053] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:31 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:31.884332 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-358e2c59-6408-4c49-a3ac-9d43f300752e req-d5027c07-7150-4240-a0b1-2829e3e55579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2", "tag": "25350c4b-3e48-496c-9881-13794cda12d0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:18:31.893661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-358e2c59-6408-4c49-a3ac-9d43f300752e req-d5027c07-7150-4240-a0b1-2829e3e55579 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:31.894217 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-358e2c59-6408-4c49-a3ac-9d43f300752e req-d5027c07-7150-4240-a0b1-2829e3e55579 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:31.894647 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-358e2c59-6408-4c49-a3ac-9d43f300752e req-d5027c07-7150-4240-a0b1-2829e3e55579 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:31.906100 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-358e2c59-6408-4c49-a3ac-9d43f300752e req-d5027c07-7150-4240-a0b1-2829e3e55579 service nova] Creating event network-changed:25350c4b-3e48-496c-9881-13794cda12d0 for instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 on hv-cinder-85535 Sep 02 09:18:31.911414 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-358e2c59-6408-4c49-a3ac-9d43f300752e req-d5027c07-7150-4240-a0b1-2829e3e55579 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030508 Sep 02 09:18:31.912000 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 533/1054] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:18:53.939660 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3cb070be-fe45-43e5-8f25-fcf26ece6274 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:18:53.941924 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3cb070be-fe45-43e5-8f25-fcf26ece6274 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:53.944421 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=13 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:53.945074 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:53.952464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cb070be-fe45-43e5-8f25-fcf26ece6274 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:53.952946 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cb070be-fe45-43e5-8f25-fcf26ece6274 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:53.953382 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cb070be-fe45-43e5-8f25-fcf26ece6274 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:53.954069 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cb070be-fe45-43e5-8f25-fcf26ece6274 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:53.954522 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cb070be-fe45-43e5-8f25-fcf26ece6274 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:53.954944 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cb070be-fe45-43e5-8f25-fcf26ece6274 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:54.027018 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3cb070be-fe45-43e5-8f25-fcf26ece6274 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "POST /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/action" status: 202 len: 0 microversion: 2.1 time: 0.091071 Sep 02 09:18:54.030598 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 522/1055] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:18:53 2022] POST /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:18:54.036529 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:54.037225 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:54.041378 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=13 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:54.042119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=35 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:18:54.046177 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:54.046661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:54.047120 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:54.047884 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:54.048339 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:54.048757 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:54.395591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:54.404993 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3180c567-9d32-4210-87d6-0a6bfb762231 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1751 microversion: 2.1 time: 0.372800 Sep 02 09:18:54.405564 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 534/1056] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:54 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1751 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:18:55.426664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:55.427396 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:55.434179 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:55.434660 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:55.435113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:55.435798 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:55.436249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:55.436674 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:55.623697 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:55.631999 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8d1ea267-a5dd-4640-beb0-9f04af269c84 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.209969 Sep 02 09:18:55.632565 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 523/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:55 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:56.653298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:56.653846 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:56.660330 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:56.660812 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:56.661242 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:56.661924 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:56.662373 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:56.662793 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:56.799571 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:56.808345 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82470b2f-db67-4592-95de-4b7447ac052e tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.158947 Sep 02 09:18:56.808902 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 535/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:56 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:57.828962 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:57.829488 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:57.836422 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:57.837150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:57.837605 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:57.838283 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:57.838730 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:57.839178 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:57.980798 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:57.988864 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-52537032-dc22-44dd-a735-a10e064e0da1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.163818 Sep 02 09:18:57.989440 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 524/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:57 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:18:59.010418 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:18:59.011013 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:18:59.017507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:59.017984 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:59.018416 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:59.019119 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:18:59.019575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:18:59.019994 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:18:59.158433 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:18:59.166982 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3c7079e3-befe-477e-88d1-868f98dd7983 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.160465 Sep 02 09:18:59.167578 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 536/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:18:59 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:00.188223 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:00.188836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:00.195133 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:00.195617 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:00.196065 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:00.196745 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:00.197195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:00.197614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:00.340650 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:00.348820 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ae9048da-5081-4ba8-aff7-0def7142cdf1 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.164475 Sep 02 09:19:00.349400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 525/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:00 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:01.370098 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:01.370706 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:01.376801 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:01.377281 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:01.377711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:01.378391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:01.378840 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:01.379298 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:01.516881 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:01.525220 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-299904f6-74e1-4bd4-8245-1adb593d36fe tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.159421 Sep 02 09:19:01.525825 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 537/1062] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:01 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:02.546067 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:02.546707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:02.553170 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:02.553648 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:02.554081 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:02.554766 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:02.555254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:02.555676 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:02.698666 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:02.706837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d55b518c-8e13-420b-a179-1894807a7f48 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.164589 Sep 02 09:19:02.707430 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 526/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:02 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:03.728266 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:03.728838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:03.735637 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:03.736120 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:03.736552 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:03.737241 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:03.737698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:03.738123 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:03.874625 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:03.882752 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-38fb0064-5801-4056-8d1e-809fc574d9b9 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.159049 Sep 02 09:19:03.883342 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 538/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:03 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:04.904805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:04.905438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:04.911636 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:04.912120 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:04.912555 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:04.913251 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:04.913711 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:04.914137 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:05.051576 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:05.060090 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eff5f815-849a-4d79-81a7-46c88ad4c86d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.159251 Sep 02 09:19:05.060653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 527/1065] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:04 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:06.081108 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:06.081725 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:06.088448 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:06.088926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:06.089358 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:06.090045 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:06.090518 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:06.090939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:06.232988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:06.241002 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dc4352f2-5804-40c6-84d8-bbf10d5869ff tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.163804 Sep 02 09:19:06.241561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 539/1066] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:06 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:07.263051 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:07.263630 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:07.270272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:07.270760 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:07.271228 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:07.271927 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:07.272380 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:07.272806 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:07.411333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:07.419484 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-318b35ae-31f2-474f-9509-0a89ae3c329d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.160923 Sep 02 09:19:07.420047 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 528/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:07 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:08.441180 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:08.441791 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:08.448140 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:08.448615 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:08.449040 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:08.449724 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:08.450173 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:08.450587 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:08.592292 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:08.600581 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-415a5b53-e89e-4a17-b832-8932d4928f3c tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.163286 Sep 02 09:19:08.601147 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 540/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:08 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:09.621350 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:09.621971 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:09.628268 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:09.628752 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:09.629191 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:09.629882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:09.630339 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:09.630776 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:09.768716 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:09.777150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c4fd7644-1bbe-41f3-905a-fbb1ab4036f5 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1756 microversion: 2.1 time: 0.159788 Sep 02 09:19:09.777704 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 529/1069] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:09 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:10.797879 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:10.798508 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:10.804736 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:10.805215 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:10.805665 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:10.806324 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:10.806775 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:10.807233 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:10.945358 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:10.953977 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-07594767-8661-453d-a990-0d8fe82f8d8a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1759 microversion: 2.1 time: 0.160043 Sep 02 09:19:10.954533 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 541/1070] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:10 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1759 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:43.091523 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2086108602"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:19:43.092066 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:43.094133 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=16 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:19:43.094793 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:19:43.096150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:19:43.096300 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Fri Sep 2 09:19:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/action (ip 10.222.0.36) !!! Sep 02 09:19:43.104293 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:43.105450 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:43.105935 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:43.106632 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:43.107134 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:43.107558 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:43.234247 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.network.security_group_api [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Removing security group f397615a-7c9e-463b-8765-e4d9ab5055d0 from port 25350c4b-3e48-496c-9881-13794cda12d0 Sep 02 09:19:43.532030 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5ef527b7-ff9f-4c28-8268-190536176fbd tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "POST /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/action" status: 202 len: 0 microversion: 2.1 time: 0.445257 Sep 02 09:19:43.532633 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 530/1071] 10.222.0.36 () {60 vars in 1278 bytes} [Fri Sep 2 09:19:43 2022] POST /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:19:43.543937 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=16 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:19:43.544676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=48 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:19:43.617769 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-3b631de8-2e70-40cf-b722-a74edd05354b req-a35de6a9-de02-41f0-ac1b-f20ad29bb07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2", "tag": "25350c4b-3e48-496c-9881-13794cda12d0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:19:43.627551 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-3b631de8-2e70-40cf-b722-a74edd05354b req-a35de6a9-de02-41f0-ac1b-f20ad29bb07c service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:43.628711 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-3b631de8-2e70-40cf-b722-a74edd05354b req-a35de6a9-de02-41f0-ac1b-f20ad29bb07c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:43.629334 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-3b631de8-2e70-40cf-b722-a74edd05354b req-a35de6a9-de02-41f0-ac1b-f20ad29bb07c service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:43.640627 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-3b631de8-2e70-40cf-b722-a74edd05354b req-a35de6a9-de02-41f0-ac1b-f20ad29bb07c service nova] Creating event network-changed:25350c4b-3e48-496c-9881-13794cda12d0 for instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 on hv-cinder-85535 Sep 02 09:19:43.645656 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-3b631de8-2e70-40cf-b722-a74edd05354b req-a35de6a9-de02-41f0-ac1b-f20ad29bb07c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106394 Sep 02 09:19:43.646250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 542/1072] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:19:45.177725 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:45.178270 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:45.185333 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:45.185814 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:45.186241 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:45.186943 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:45.187438 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:45.187860 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:45.279481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lazy-loading 'services' on Instance uuid d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:19:45.355113 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9f1dcf43-a15e-4455-aba6-440a26bdc929 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments/d7ace4fd-3b17-40ad-b297-76f6da4206fb" status: 202 len: 0 microversion: 2.1 time: 0.181017 Sep 02 09:19:45.358847 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 531/1073] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:19:45 2022] DELETE /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments/d7ace4fd-3b17-40ad-b297-76f6da4206fb => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:19:45.365478 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4c9c9788-39a9-4939-8fbb-38a416f6c22a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:45.367755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4c9c9788-39a9-4939-8fbb-38a416f6c22a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:45.376164 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9c9788-39a9-4939-8fbb-38a416f6c22a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:45.376940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9c9788-39a9-4939-8fbb-38a416f6c22a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:45.377583 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9c9788-39a9-4939-8fbb-38a416f6c22a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:45.378291 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9c9788-39a9-4939-8fbb-38a416f6c22a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:45.378767 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9c9788-39a9-4939-8fbb-38a416f6c22a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:45.379230 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9c9788-39a9-4939-8fbb-38a416f6c22a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:45.409988 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4c9c9788-39a9-4939-8fbb-38a416f6c22a tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049357 Sep 02 09:19:45.410471 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 543/1074] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:19:45 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:19:45.661037 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-3bb98407-ae4b-4a65-bbba-19344fd12b44 req-dc64c227-20a2-4ee8-8eb6-61d2ce63e198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2", "tag": "25350c4b-3e48-496c-9881-13794cda12d0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:19:45.670867 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3bb98407-ae4b-4a65-bbba-19344fd12b44 req-dc64c227-20a2-4ee8-8eb6-61d2ce63e198 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:45.671469 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3bb98407-ae4b-4a65-bbba-19344fd12b44 req-dc64c227-20a2-4ee8-8eb6-61d2ce63e198 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:45.672011 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3bb98407-ae4b-4a65-bbba-19344fd12b44 req-dc64c227-20a2-4ee8-8eb6-61d2ce63e198 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:45.682699 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-3bb98407-ae4b-4a65-bbba-19344fd12b44 req-dc64c227-20a2-4ee8-8eb6-61d2ce63e198 service nova] Creating event network-changed:25350c4b-3e48-496c-9881-13794cda12d0 for instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 on hv-cinder-85535 Sep 02 09:19:45.687456 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-3bb98407-ae4b-4a65-bbba-19344fd12b44 req-dc64c227-20a2-4ee8-8eb6-61d2ce63e198 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030476 Sep 02 09:19:45.688031 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 532/1075] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:19:46.423330 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf41c880-ba89-47bb-b469-c23d6d773182 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:46.425505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bf41c880-ba89-47bb-b469-c23d6d773182 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:46.431761 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf41c880-ba89-47bb-b469-c23d6d773182 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:46.432241 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf41c880-ba89-47bb-b469-c23d6d773182 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:46.432672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf41c880-ba89-47bb-b469-c23d6d773182 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:46.434020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf41c880-ba89-47bb-b469-c23d6d773182 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:46.434471 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf41c880-ba89-47bb-b469-c23d6d773182 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:46.434892 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf41c880-ba89-47bb-b469-c23d6d773182 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:46.462252 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bf41c880-ba89-47bb-b469-c23d6d773182 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042944 Sep 02 09:19:46.463098 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 544/1076] 10.222.0.36 () {58 vars in 1302 bytes} [Fri Sep 2 09:19:46 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:19:46.474252 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:46.474825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:46.481358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:46.481836 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:46.482262 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:46.482932 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:46.483404 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:46.483821 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:46.559743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] HTTP exception thrown: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 is not attached to volume d7ace4fd-3b17-40ad-b297-76f6da4206fb Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Request method failure captured: Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments/d7ace4fd-3b17-40ad-b297-76f6da4206fb HTTP/1.1 Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEco4xwFHyatj9KuXyNOoaPCfPOVJCqN1o4UHC_hUgbn20A_t_g8w67NCsy1_b0ZNa8Wf_-lH2ZCklh3xwOCjzJ5-AypUqAw78GH1zkiArAmXTKIs05xaLA1v8hvLvDGJaIcPs9G1Yhm_6YdEFKuB94DSv50xE8TKGdlpiA9wcQ7VBDA Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: b133928ce6ac4acaa1b0c224909c76fd Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestMinimumBasicScenario-605232910 Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:19:46.562104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b133928ce6ac4acaa1b0c224909c76fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b133928ce6ac4acaa1b0c224909c76fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b133928ce6ac4acaa1b0c224909c76fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b133928ce6ac4acaa1b0c224909c76fd", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestMinimumBasicScenario-605232910 Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: b133928ce6ac4acaa1b0c224909c76fd Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestMinimumBasicScenario-605232910 Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-TestMinimumBasicScenario-605232910-project Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: fa92771235f04c668690cd05d4a2b44c Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestMinimumBasicScenario-605232910-project Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:19:46.563894 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 is not attached to volume d7ace4fd-3b17-40ad-b297-76f6da4206fb Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'server_id': 'd39895e7-d3c2-4ab4-8fdd-fde604f2a6b2', 'id': 'd7ace4fd-3b17-40ad-b297-76f6da4206fb'} Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d7ace4fd-3b17-40ad-b297-76f6da4206fb. Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:19:46.564852 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 is not attached to volume d7ace4fd-3b17-40ad-b297-76f6da4206fb Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 is not attached to volume d7ace4fd-3b17-40ad-b297-76f6da4206fb Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:46.566203 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Returning 404 to user: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 is not attached to volume d7ace4fd-3b17-40ad-b297-76f6da4206fb {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:19:46.567256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1d1f1d58-d711-4d26-b46c-184b46e1a7cc tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments/d7ace4fd-3b17-40ad-b297-76f6da4206fb" status: 404 len: 154 microversion: 2.1 time: 0.093993 Sep 02 09:19:46.567256 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 533/1077] 10.222.0.36 () {58 vars in 1416 bytes} [Fri Sep 2 09:19:46 2022] DELETE /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2/os-volume_attachments/d7ace4fd-3b17-40ad-b297-76f6da4206fb => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:19:47.698692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:47.699205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:47.705367 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:47.705844 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:47.706272 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:47.706952 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:47.707430 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:47.707849 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:47.732325 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:19:47.805939 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b3b3fe93-3ef1-40f4-9913-82235dc7d43b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 204 len: 0 microversion: 2.1 time: 0.110272 Sep 02 09:19:47.806581 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 545/1078] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:19:47 2022] DELETE /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:19:47.815430 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:47.816048 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:47.824238 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:47.824707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:47.825150 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:47.825837 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:47.826291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:47.826717 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:47.951008 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:47.958520 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dc61d91d-5411-419d-bfa0-5a4e3e2b389b tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1554 microversion: 2.1 time: 0.146967 Sep 02 09:19:47.959077 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 534/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:47 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:48.980399 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:48.981142 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:48.988038 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:48.988566 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:48.988999 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:48.989689 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:48.990143 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:48.990565 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:49.116901 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:49.130516 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-700a13da-7350-4291-93ce-7bfddbfaf1a4 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1554 microversion: 2.1 time: 0.154301 Sep 02 09:19:49.131108 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 546/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:48 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:50.151930 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:50.152546 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:50.159840 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:50.160338 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:50.160751 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:50.161439 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:50.161889 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:50.162309 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:50.344531 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-948bd40e-b7d8-4616-a89a-0c3740ae0ddd req-807c4baf-27f6-4021-865d-5e1c3624b118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2", "name": "network-vif-deleted", "tag": "25350c4b-3e48-496c-9881-13794cda12d0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:19:50.367180 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-948bd40e-b7d8-4616-a89a-0c3740ae0ddd req-807c4baf-27f6-4021-865d-5e1c3624b118 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:50.368169 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-948bd40e-b7d8-4616-a89a-0c3740ae0ddd req-807c4baf-27f6-4021-865d-5e1c3624b118 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:50.368712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-948bd40e-b7d8-4616-a89a-0c3740ae0ddd req-807c4baf-27f6-4021-865d-5e1c3624b118 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:50.374839 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa92771235f04c668690cd05d4a2b44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b133928ce6ac4acaa1b0c224909c76fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:19:50.381439 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-948bd40e-b7d8-4616-a89a-0c3740ae0ddd req-807c4baf-27f6-4021-865d-5e1c3624b118 service nova] Creating event network-vif-deleted:25350c4b-3e48-496c-9881-13794cda12d0 for instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 on hv-cinder-85535 Sep 02 09:19:50.384738 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-76c88e8e-e743-4ee1-a043-0c5bfa45c639 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 200 len: 1554 microversion: 2.1 time: 0.236817 Sep 02 09:19:50.385266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 535/1081] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:50 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:19:50.387174 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-948bd40e-b7d8-4616-a89a-0c3740ae0ddd req-807c4baf-27f6-4021-865d-5e1c3624b118 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046115 Sep 02 09:19:50.390250 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 547/1082] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:19:51.406308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:51.406918 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] [instance: d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:19:51.413294 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:51.413772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:51.414199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:51.414874 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:19:51.415353 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:19:51.415772 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:19:51.429104 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] HTTP exception thrown: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 could not be found. Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Request method failure captured: Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 HTTP/1.1 Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEco4xwFHyatj9KuXyNOoaPCfPOVJCqN1o4UHC_hUgbn20A_t_g8w67NCsy1_b0ZNa8Wf_-lH2ZCklh3xwOCjzJ5-AypUqAw78GH1zkiArAmXTKIs05xaLA1v8hvLvDGJaIcPs9G1Yhm_6YdEFKuB94DSv50xE8TKGdlpiA9wcQ7VBDA Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: b133928ce6ac4acaa1b0c224909c76fd Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestMinimumBasicScenario-605232910 Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:19:51.430586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b133928ce6ac4acaa1b0c224909c76fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b133928ce6ac4acaa1b0c224909c76fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b133928ce6ac4acaa1b0c224909c76fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b133928ce6ac4acaa1b0c224909c76fd", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestMinimumBasicScenario-605232910 Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: b133928ce6ac4acaa1b0c224909c76fd Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestMinimumBasicScenario-605232910 Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-TestMinimumBasicScenario-605232910-project Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: fa92771235f04c668690cd05d4a2b44c Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestMinimumBasicScenario-605232910-project Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 could not be found. Sep 02 09:19:51.432249 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': 'd39895e7-d3c2-4ab4-8fdd-fde604f2a6b2'} Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 could not be found. Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:19:51.433194 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 could not be found. Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 could not be found. Sep 02 09:19:51.435321 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:19:51.436790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Returning 404 to user: Instance d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:19:51.436790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ad0991f4-dd75-4528-82dc-b767a34bff8d tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2" status: 404 len: 111 microversion: 2.1 time: 0.029505 Sep 02 09:19:51.436790 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 536/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:19:51 2022] GET /compute/v2.1/servers/d39895e7-d3c2-4ab4-8fdd-fde604f2a6b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:19:51.442080 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eb0dd24a-0d27-4dfe-b707-5e6b2ff9c151 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] Calling method '.version_select at 0x7f54bc5cd160>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:19:51.460182 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eb0dd24a-0d27-4dfe-b707-5e6b2ff9c151 tempest-TestMinimumBasicScenario-605232910 tempest-TestMinimumBasicScenario-605232910-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-513916534" status: 202 len: 0 microversion: 2.1 time: 0.022600 Sep 02 09:19:51.460729 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 548/1084] 10.222.0.36 () {58 vars in 1269 bytes} [Fri Sep 2 09:19:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-513916534 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:20:01.853193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:01.853711 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:01.856937 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=14 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:20:01.857973 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:20:01.864825 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:01.865315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:01.865753 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:01.866450 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:01.866907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:01.867373 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:01.892866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:20:01.964838 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2221867d-b097-4767-a3e2-42f83ff33bdc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 204 len: 0 microversion: 2.1 time: 0.115152 Sep 02 09:20:01.965578 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 537/1085] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:20:01 2022] DELETE /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:20:01.972169 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:20:01.972889 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:20:01.976701 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:01.977436 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:01.985936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:01.986428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:01.986862 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:01.987591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:01.988047 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:01.988472 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:02.118507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:02.126645 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d9c318e9-c759-4eec-918e-39085d7b28a5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1579 microversion: 2.1 time: 0.156131 Sep 02 09:20:02.127231 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 549/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:01 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:03.147700 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:03.148402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:03.154305 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:03.154791 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:03.155274 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:03.155965 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:03.156428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:03.156850 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:03.541217 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:03.549244 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0950af0b-8b79-4b70-9d09-772c1755cdf4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1579 microversion: 2.1 time: 0.405925 Sep 02 09:20:03.549848 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 538/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:03 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1579 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:04.503282 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-f51d56cd-5bf5-49db-b97a-28c67859f98c req-435a7da4-1d05-43f4-9408-a45119d401c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a", "name": "network-vif-deleted", "tag": "a49cb379-757d-43a1-a4a1-d6366ca61c54"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:20:04.514745 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f51d56cd-5bf5-49db-b97a-28c67859f98c req-435a7da4-1d05-43f4-9408-a45119d401c8 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:04.515253 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f51d56cd-5bf5-49db-b97a-28c67859f98c req-435a7da4-1d05-43f4-9408-a45119d401c8 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:04.515676 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f51d56cd-5bf5-49db-b97a-28c67859f98c req-435a7da4-1d05-43f4-9408-a45119d401c8 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:04.527817 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-f51d56cd-5bf5-49db-b97a-28c67859f98c req-435a7da4-1d05-43f4-9408-a45119d401c8 service nova] Creating event network-vif-deleted:a49cb379-757d-43a1-a4a1-d6366ca61c54 for instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a on hv-cinder-85535 Sep 02 09:20:04.533212 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-f51d56cd-5bf5-49db-b97a-28c67859f98c req-435a7da4-1d05-43f4-9408-a45119d401c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034070 Sep 02 09:20:04.533834 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 550/1088] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:20:04.569761 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:04.570380 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:04.580195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:04.585325 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:04.586138 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:04.587182 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:04.588132 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:04.588880 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:04.665585 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:04.674610 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-97b26c6a-d095-4019-a1d9-61d3c78d0075 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 200 len: 1226 microversion: 2.1 time: 0.108614 Sep 02 09:20:04.675205 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 539/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:04 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:05.695314 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:05.696010 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:05.702591 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:05.703097 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:05.703534 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:05.704223 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:05.704677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:05.705099 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:05.718951 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] HTTP exception thrown: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Request method failure captured: Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a HTTP/1.1 Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcocT3knZepyiG8HgZxMVxJAmyjdsu2MEeYB7t8txTvEFmTALGb3IJH4aTjoh0aJhsK6b6veWgz4L2Qb0aJJOZFzqDNW4kj9SHdWeT8rhJkbuvZZ2Qj6UNWcsfKjePiyNjR-IAivWWPnAc0HvG-nskvrMmJbhNV3YFaBzZbgPNHj6uI Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:20:05.720575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a09b3fcd4fdc424086b7ca6b15d0a4e9", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestVolumeBootPattern-45464667 Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 7e1f6e80465a44d0a90200ada3f43e23 Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:20:05.722245 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': 'e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a'} Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:20:05.723454 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:20:05.725078 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:20:05.726505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Returning 404 to user: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:20:05.726505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c7f4bbd7-6025-420a-98d7-dde5eecaaa2c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 404 len: 111 microversion: 2.1 time: 0.031338 Sep 02 09:20:05.726505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 551/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:05 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:20:05.813653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1050820363", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1541286053", "security_groups": [{"name": "tempest-secgroup-smoke-385705346"}], "block_device_mapping_v2": [{"uuid": "064179a4-6996-4c21-94cd-0cc8c5da492c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ad15bb0-c129-4f42-a06e-290f3ce89bff"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:20:05.923813 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] validate_networks() for [('9ad15bb0-c129-4f42-a06e-290f3ce89bff', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:20:06.291657 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:20:06.292071 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:20:06.292540 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:20:06.292985 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:20:06.293390 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:20:06.302530 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:06.302986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:06.303442 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:06.304153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:06.304603 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:06.305021 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:06.324178 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Getting quotas for project a09b3fcd4fdc424086b7ca6b15d0a4e9. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:20:06.328264 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Getting quotas for user 7e1f6e80465a44d0a90200ada3f43e23 and project a09b3fcd4fdc424086b7ca6b15d0a4e9. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:20:06.385153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:20:06.387789 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='064179a4-6996-4c21-94cd-0cc8c5da492c',volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:20:06.512983 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4feb86f3-34c6-4d2b-aa77-02df4ef10430 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703073 Sep 02 09:20:06.513633 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 540/1091] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:20:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:20:06.524409 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d3a769ca-8df1-4aec-818e-40f8ecb03a97 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:06.525020 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d3a769ca-8df1-4aec-818e-40f8ecb03a97 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:06.581485 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d3a769ca-8df1-4aec-818e-40f8ecb03a97 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:06.588738 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d3a769ca-8df1-4aec-818e-40f8ecb03a97 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1095 microversion: 2.1 time: 0.068167 Sep 02 09:20:06.589307 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 552/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:06 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:07.610720 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:07.611611 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:07.622273 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:07.623109 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:07.623691 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:07.624511 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:07.625092 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:07.625618 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:07.717038 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:07.725455 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cec27bf7-310b-4da7-b31c-94c05a61e418 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1201 microversion: 2.1 time: 0.120097 Sep 02 09:20:07.726023 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 541/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:07 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1201 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:20:08.745681 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:08.746299 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:08.754311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:08.754805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:08.755277 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:08.755981 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:08.756491 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:08.757077 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:08.968239 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:08.976432 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dbf4e970-cbcd-42e6-bb72-4d33f77bc936 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.234142 Sep 02 09:20:08.976577 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 553/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:08 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:09.072674 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-0a7fae67-a4b0-433a-8fae-baca9fb0a5ab req-ba54dcc6-e0e9-41d2-90b0-8a7898575ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32372892-f492-4315-bd22-32344e4a0023", "tag": "b153dace-d7dc-499b-8259-5cc5f57bc371"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:20:09.083143 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0a7fae67-a4b0-433a-8fae-baca9fb0a5ab req-ba54dcc6-e0e9-41d2-90b0-8a7898575ce8 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:09.083842 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0a7fae67-a4b0-433a-8fae-baca9fb0a5ab req-ba54dcc6-e0e9-41d2-90b0-8a7898575ce8 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:09.084268 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0a7fae67-a4b0-433a-8fae-baca9fb0a5ab req-ba54dcc6-e0e9-41d2-90b0-8a7898575ce8 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:09.096762 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-0a7fae67-a4b0-433a-8fae-baca9fb0a5ab req-ba54dcc6-e0e9-41d2-90b0-8a7898575ce8 service nova] Creating event network-changed:b153dace-d7dc-499b-8259-5cc5f57bc371 for instance 32372892-f492-4315-bd22-32344e4a0023 on hv-cinder-85535 Sep 02 09:20:09.101634 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-0a7fae67-a4b0-433a-8fae-baca9fb0a5ab req-ba54dcc6-e0e9-41d2-90b0-8a7898575ce8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032532 Sep 02 09:20:09.102328 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 542/1095] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:20:09.997777 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:09.998527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:10.004924 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:10.005410 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:10.005848 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:10.006546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:10.007005 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:10.007462 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:10.236677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:10.244360 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0053cbef-b6bf-4b4b-999a-5812ed0a082d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.251034 Sep 02 09:20:10.244936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 554/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:09 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:11.265767 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:11.266406 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:11.272500 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:11.272967 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:11.273401 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:11.274089 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:11.274545 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:11.274971 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:11.405900 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:11.413417 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9c4f420a-e1ea-47f0-94a1-c59f2dc12c04 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.152354 Sep 02 09:20:11.413981 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 543/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:11 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:12.433693 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:12.434311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:12.440712 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:12.441191 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:12.441626 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:12.442315 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:12.442770 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:12.443227 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:12.582343 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:12.590172 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-37cc299e-e396-4014-82ff-681dc4ae05f4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.160288 Sep 02 09:20:12.591270 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 555/1098] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:12 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:13.611625 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:13.612181 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:13.618457 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:13.618939 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:13.619408 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:13.620099 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:13.620552 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:13.620975 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:13.746320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:13.753795 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b73ec7b-36b5-4dc4-b8ab-13f2158b074a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.146066 Sep 02 09:20:13.754355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 544/1099] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:13 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:14.773805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:14.774348 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:14.781214 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:14.781694 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:14.782149 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:14.782829 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:14.783309 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:14.783730 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:14.912936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:14.920558 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7836ca00-8f97-457d-963c-196bdc403af5 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.150712 Sep 02 09:20:14.921129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 556/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:14 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:15.941050 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:15.941654 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:15.948018 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:15.948497 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:15.948923 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:15.949600 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:15.950046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:15.950465 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:16.077195 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:16.084682 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-67f6fd7c-8477-4928-b0f5-66b86c4ea8eb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.147489 Sep 02 09:20:16.085243 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 545/1101] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:15 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:17.106028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:17.106635 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:17.109063 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:20:17.114505 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:17.114979 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:17.115437 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:17.116118 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:17.116567 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:17.116987 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:17.247498 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:17.261784 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b72e633e-5e93-49f8-ab3e-6c6b4337c18a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.159663 Sep 02 09:20:17.262347 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 557/1102] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:17 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:18.283407 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:18.284025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:18.285960 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:20:18.286756 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:20:18.294567 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:18.295183 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:18.295620 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:18.296324 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:18.296787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:18.297213 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:18.434270 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:18.445786 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-15e7ebd6-821e-4758-8e1b-562b4d718585 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.165778 Sep 02 09:20:18.446846 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 546/1103] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:18 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:18.514028 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-6c4ab318-3953-4b61-94eb-e4fa4be65e26 req-f74016e7-bcc4-4856-bd96-d7e62da532c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32372892-f492-4315-bd22-32344e4a0023", "name": "network-vif-plugged", "status": "completed", "tag": "b153dace-d7dc-499b-8259-5cc5f57bc371"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:20:18.523188 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6c4ab318-3953-4b61-94eb-e4fa4be65e26 req-f74016e7-bcc4-4856-bd96-d7e62da532c5 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:18.523661 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6c4ab318-3953-4b61-94eb-e4fa4be65e26 req-f74016e7-bcc4-4856-bd96-d7e62da532c5 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:18.524084 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6c4ab318-3953-4b61-94eb-e4fa4be65e26 req-f74016e7-bcc4-4856-bd96-d7e62da532c5 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:18.535265 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-6c4ab318-3953-4b61-94eb-e4fa4be65e26 req-f74016e7-bcc4-4856-bd96-d7e62da532c5 service nova] Creating event network-vif-plugged:b153dace-d7dc-499b-8259-5cc5f57bc371 for instance 32372892-f492-4315-bd22-32344e4a0023 on hv-cinder-85535 Sep 02 09:20:18.540210 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-6c4ab318-3953-4b61-94eb-e4fa4be65e26 req-f74016e7-bcc4-4856-bd96-d7e62da532c5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159876 Sep 02 09:20:18.540775 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 558/1104] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:20:19.467769 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:19.468403 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:19.474664 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:19.475166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:19.475598 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:19.476302 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:19.476735 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:19.477153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:19.606845 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:19.614426 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-22f4ed83-a438-47b0-91a7-4f0e6e4c2faf tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1266 microversion: 2.1 time: 0.151524 Sep 02 09:20:19.614994 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 547/1105] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:19 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:20.635826 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:20.636527 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:20.642600 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:20.643111 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:20.643556 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:20.644255 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:20.644714 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:20.645143 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:20.772692 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:20.780239 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b1a172b-a6e9-42ce-a04a-eff35d309ce4 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1454 microversion: 2.1 time: 0.149174 Sep 02 09:20:20.780805 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 559/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:20 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:20.800265 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:20:20.800885 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:20:20.807193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:20.807678 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:20.808123 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:20.809517 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:20.809973 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:20.810400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:20.941088 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:20:20.948658 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1770ccdd-8268-4e9c-859f-52c96daa2a40 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1454 microversion: 2.1 time: 0.152132 Sep 02 09:20:20.949634 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 548/1107] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:20:20 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:20:22.739212 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-fd4091ca-2ede-42a2-87b7-b00daaee024b req-e070e2a7-d54c-47ed-9b63-dd93c53b5093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32372892-f492-4315-bd22-32344e4a0023", "tag": "b153dace-d7dc-499b-8259-5cc5f57bc371"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:20:22.748915 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-fd4091ca-2ede-42a2-87b7-b00daaee024b req-e070e2a7-d54c-47ed-9b63-dd93c53b5093 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:20:22.749393 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-fd4091ca-2ede-42a2-87b7-b00daaee024b req-e070e2a7-d54c-47ed-9b63-dd93c53b5093 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:20:22.749820 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-fd4091ca-2ede-42a2-87b7-b00daaee024b req-e070e2a7-d54c-47ed-9b63-dd93c53b5093 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:20:22.760800 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-fd4091ca-2ede-42a2-87b7-b00daaee024b req-e070e2a7-d54c-47ed-9b63-dd93c53b5093 service nova] Creating event network-changed:b153dace-d7dc-499b-8259-5cc5f57bc371 for instance 32372892-f492-4315-bd22-32344e4a0023 on hv-cinder-85535 Sep 02 09:20:22.765926 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-fd4091ca-2ede-42a2-87b7-b00daaee024b req-e070e2a7-d54c-47ed-9b63-dd93c53b5093 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030440 Sep 02 09:20:22.766620 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 560/1108] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:22:09.531674 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:22:09.532411 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:22:09.537425 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-711028409", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1541286053", "security_groups": [{"name": "tempest-secgroup-smoke-385705346"}], "block_device_mapping_v2": [{"uuid": "e81bf59e-0ae6-431e-8593-53d0238163be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ad15bb0-c129-4f42-a06e-290f3ce89bff"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:22:09.649144 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] validate_networks() for [('9ad15bb0-c129-4f42-a06e-290f3ce89bff', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:22:10.005862 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:22:10.006291 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:22:10.006774 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:22:10.007210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:22:10.007624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:22:10.016507 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:10.016987 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:10.017425 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:10.018153 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:10.018612 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:10.019039 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:10.035927 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Getting quotas for project a09b3fcd4fdc424086b7ca6b15d0a4e9. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:22:10.039826 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Getting quotas for user 7e1f6e80465a44d0a90200ada3f43e23 and project a09b3fcd4fdc424086b7ca6b15d0a4e9. Resources: {'ram', 'instances', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:22:10.095241 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:22:10.097315 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e81bf59e-0ae6-431e-8593-53d0238163be',volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:22:10.224341 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fe93752f-071b-444e-8c2e-a936f7116964 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.694428 Sep 02 09:22:10.224986 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 549/1109] 10.222.0.36 () {60 vars in 1147 bytes} [Fri Sep 2 09:22:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:22:10.234717 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=26 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:22:10.235620 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=50 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:22:10.237108 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:22:10.237253 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Fri Sep 2 09:22:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 (ip 10.222.0.36) !!! Sep 02 09:22:10.242167 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-72a7ecc0-e6c0-4f8a-8deb-28e3cd2c4589 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:10.242882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-72a7ecc0-e6c0-4f8a-8deb-28e3cd2c4589 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:10.299618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-72a7ecc0-e6c0-4f8a-8deb-28e3cd2c4589 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:10.306885 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-72a7ecc0-e6c0-4f8a-8deb-28e3cd2c4589 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1094 microversion: 2.1 time: 0.074272 Sep 02 09:22:10.307477 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 561/1110] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:10 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:11.329633 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:11.330204 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:11.337670 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:11.338308 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:11.338754 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:11.339483 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:11.340248 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:11.340679 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:11.412029 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:11.420063 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c7b9d7df-57f2-4e7b-8b4e-8b7435447c5b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1210 microversion: 2.1 time: 0.095720 Sep 02 09:22:11.420624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 550/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:11 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:22:12.440750 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:12.441361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:12.448260 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:12.448745 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:12.449176 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:12.450412 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:12.450864 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:12.451311 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:12.651874 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:12.659824 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c4f89d5-0e83-4384-83a4-23de39959a99 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.222999 Sep 02 09:22:12.660401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 562/1112] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:12 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:12.703473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-d0815c33-c50a-41a4-8390-a8fbf0a313d0 req-94fc0a65-8eda-46f8-a850-399f10685c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceaebed-8591-4b18-a14e-f5e78e05baf3", "tag": "2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:22:12.714735 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d0815c33-c50a-41a4-8390-a8fbf0a313d0 req-94fc0a65-8eda-46f8-a850-399f10685c43 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:12.715250 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d0815c33-c50a-41a4-8390-a8fbf0a313d0 req-94fc0a65-8eda-46f8-a850-399f10685c43 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:12.715681 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d0815c33-c50a-41a4-8390-a8fbf0a313d0 req-94fc0a65-8eda-46f8-a850-399f10685c43 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:12.726484 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-d0815c33-c50a-41a4-8390-a8fbf0a313d0 req-94fc0a65-8eda-46f8-a850-399f10685c43 service nova] Creating event network-changed:2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee for instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 on hv-cinder-85535 Sep 02 09:22:12.729798 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR oslo.messaging._drivers.impl_rabbit [req-d0815c33-c50a-41a4-8390-a8fbf0a313d0 req-94fc0a65-8eda-46f8-a850-399f10685c43 service nova] [7b1ab4cf-8658-4138-911b-87ac8e8307d1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 09:22:13.680420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:13.681200 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:13.687773 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:13.688247 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:13.688677 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:13.689395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:13.689846 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:13.690264 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:13.738340 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [req-d0815c33-c50a-41a4-8390-a8fbf0a313d0 req-94fc0a65-8eda-46f8-a850-399f10685c43 service nova] [7b1ab4cf-8658-4138-911b-87ac8e8307d1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57560. Sep 02 09:22:13.741603 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-d0815c33-c50a-41a4-8390-a8fbf0a313d0 req-94fc0a65-8eda-46f8-a850-399f10685c43 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042716 Sep 02 09:22:13.742248 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 551/1113] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:22:13.866471 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:13.874361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d52915a-99c3-4c5d-a046-90099b1b38dd tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.198010 Sep 02 09:22:13.874943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 563/1114] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:13 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:22:14.896400 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:14.897238 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:14.903486 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:14.903972 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:14.904411 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:14.905103 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:14.905566 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:14.905990 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:15.036907 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:15.044487 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-649e8603-90ee-47b2-85a4-4e38cea89a29 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.152886 Sep 02 09:22:15.045043 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 552/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:14 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:16.064780 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:16.065401 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:16.071903 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:16.072395 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:16.072832 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:16.073525 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:16.074010 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:16.074922 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:16.209261 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:16.217027 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8f415aef-1979-42f3-904f-f3e6e3394451 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.156219 Sep 02 09:22:16.217594 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 564/1116] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:16 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:17.237193 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:17.237803 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:17.244130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:17.244614 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:17.245050 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:17.245737 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:17.246687 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:17.247135 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:17.377005 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:17.384778 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7c4aa7b1-7842-4973-bf15-c8958a646a88 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.151407 Sep 02 09:22:17.385339 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 553/1117] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:17 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:18.406007 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:18.406619 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:18.412943 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:18.413419 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:18.413848 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:18.414530 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:18.414980 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:18.415426 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:18.548169 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:18.555752 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f13596b7-42c6-4816-bd1f-c1fdaad0a7d8 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.154156 Sep 02 09:22:18.556316 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 565/1118] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:18 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:19.575873 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:19.576481 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:19.582838 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:19.583348 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:19.583775 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:19.584451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:19.584900 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:19.585317 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:19.716613 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:19.724080 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1402bb33-8ecd-4df6-9826-89bb43d6688d tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.152011 Sep 02 09:22:19.724643 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 554/1119] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:19 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:20.744664 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:20.745308 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:20.748296 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:22:20.753675 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:20.754161 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:20.754597 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:20.755322 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:20.755781 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:20.756201 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:20.883672 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:20.891129 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fe674da1-b32b-4b21-9d93-9d17a91b9a92 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.150283 Sep 02 09:22:20.891698 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 566/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:20 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:21.912046 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:21.912650 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:21.914543 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:22:21.915300 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:22:21.921715 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:21.922186 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:21.922616 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:21.923546 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:21.923755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:21.924173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:22.055198 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:22.063286 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0fc8bf68-b8f7-465b-b669-828688db4478 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.155029 Sep 02 09:22:22.063848 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 555/1121] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:21 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:23.103528 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-ca17b5af-3903-4584-ae7f-548f2d38e632 req-7b13e78f-f6f6-4d2e-8db0-d99f13347489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ceaebed-8591-4b18-a14e-f5e78e05baf3", "name": "network-vif-plugged", "status": "completed", "tag": "2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:22:23.117036 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ca17b5af-3903-4584-ae7f-548f2d38e632 req-7b13e78f-f6f6-4d2e-8db0-d99f13347489 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:23.117514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ca17b5af-3903-4584-ae7f-548f2d38e632 req-7b13e78f-f6f6-4d2e-8db0-d99f13347489 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:23.117943 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ca17b5af-3903-4584-ae7f-548f2d38e632 req-7b13e78f-f6f6-4d2e-8db0-d99f13347489 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:23.130233 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-ca17b5af-3903-4584-ae7f-548f2d38e632 req-7b13e78f-f6f6-4d2e-8db0-d99f13347489 service nova] Creating event network-vif-plugged:2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee for instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 on hv-cinder-85535 Sep 02 09:22:23.136187 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-ca17b5af-3903-4584-ae7f-548f2d38e632 req-7b13e78f-f6f6-4d2e-8db0-d99f13347489 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036932 Sep 02 09:22:23.137653 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 556/1122] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:22:23.138449 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:23.139490 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:23.145541 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:23.146027 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:23.146466 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:23.147216 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:23.147678 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:23.148103 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:23.285264 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:23.293586 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-103f191a-0ac5-419a-9b54-0d005d8c56ae tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.212989 Sep 02 09:22:23.294122 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 567/1123] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:23 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:24.316259 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:24.316949 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:24.322943 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:24.323450 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:24.323882 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:24.324563 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:24.325015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:24.325433 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:24.473188 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:24.481292 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e2ce35ba-16aa-484b-a9da-062ebaf81e66 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1265 microversion: 2.1 time: 0.169657 Sep 02 09:22:24.481847 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 557/1124] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:24 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:25.501336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:25.501950 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:25.508361 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:25.508843 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:25.509280 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:25.509970 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:25.510428 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:25.510852 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:25.641458 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:25.649069 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2c15006e-449c-42ba-ae55-9df65df0ffb7 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1452 microversion: 2.1 time: 0.151595 Sep 02 09:22:25.649641 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 568/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:25 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:25.668656 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:22:25.669272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:22:25.675566 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:25.676052 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:25.676491 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:25.677173 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:25.677630 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:25.678053 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:25.810642 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:22:25.818329 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b6712726-92f8-4929-bb40-7f8225d31d10 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1452 microversion: 2.1 time: 0.153447 Sep 02 09:22:25.818892 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 558/1126] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:22:25 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:22:27.343392 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-538d5b09-c92e-4dd2-99e6-bfdaf4223c37 req-80538b54-6157-48fb-a5f6-38bef84f0eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceaebed-8591-4b18-a14e-f5e78e05baf3", "tag": "2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:22:27.354087 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-538d5b09-c92e-4dd2-99e6-bfdaf4223c37 req-80538b54-6157-48fb-a5f6-38bef84f0eef service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:22:27.354936 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-538d5b09-c92e-4dd2-99e6-bfdaf4223c37 req-80538b54-6157-48fb-a5f6-38bef84f0eef service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:22:27.355630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-538d5b09-c92e-4dd2-99e6-bfdaf4223c37 req-80538b54-6157-48fb-a5f6-38bef84f0eef service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:22:27.366954 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-538d5b09-c92e-4dd2-99e6-bfdaf4223c37 req-80538b54-6157-48fb-a5f6-38bef84f0eef service nova] Creating event network-changed:2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee for instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 on hv-cinder-85535 Sep 02 09:22:27.372263 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-538d5b09-c92e-4dd2-99e6-bfdaf4223c37 req-80538b54-6157-48fb-a5f6-38bef84f0eef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033192 Sep 02 09:22:27.372879 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 569/1127] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:23:56.280938 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:56.281866 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=48 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:56.283387 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:23:56.283542 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Fri Sep 2 09:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 (ip 10.222.0.36) !!! Sep 02 09:23:56.288368 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=20 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:56.289030 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=44 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:23:56.289863 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:23:56.290056 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Fri Sep 2 09:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Sep 02 09:23:56.299098 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:23:56.299985 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:23:56.301375 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-41c6d5b5-9df9-4b99-8eb5-03da848b39b7 req-f4109fce-ec99-4673-80ab-a523c93890f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceaebed-8591-4b18-a14e-f5e78e05baf3", "tag": "2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:23:56.306582 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:56.307428 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:56.308112 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:56.309057 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:56.309752 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:56.310402 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:56.312049 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-41c6d5b5-9df9-4b99-8eb5-03da848b39b7 req-f4109fce-ec99-4673-80ab-a523c93890f4 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:56.312755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-41c6d5b5-9df9-4b99-8eb5-03da848b39b7 req-f4109fce-ec99-4673-80ab-a523c93890f4 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:56.313372 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-41c6d5b5-9df9-4b99-8eb5-03da848b39b7 req-f4109fce-ec99-4673-80ab-a523c93890f4 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:56.328630 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-41c6d5b5-9df9-4b99-8eb5-03da848b39b7 req-f4109fce-ec99-4673-80ab-a523c93890f4 service nova] Creating event network-changed:2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee for instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 on hv-cinder-85535 Sep 02 09:23:56.334136 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-41c6d5b5-9df9-4b99-8eb5-03da848b39b7 req-f4109fce-ec99-4673-80ab-a523c93890f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047876 Sep 02 09:23:56.334992 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 570/1128] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:23:56.345587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:23:56.445624 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-569e29b7-7380-41b8-bf13-896565d1b908 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 204 len: 0 microversion: 2.1 time: 0.166884 Sep 02 09:23:56.446755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 559/1129] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:23:56 2022] DELETE /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:23:56.456440 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:23:56.457138 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:23:56.469305 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:56.469807 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:56.470251 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:56.470952 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:56.471497 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:56.471925 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:56.721016 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:23:56.731838 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2ff86651-31b4-4a4a-ad8a-dd1a4b22cffb tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1577 microversion: 2.1 time: 0.280877 Sep 02 09:23:56.732420 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 571/1130] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:23:56 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1577 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:23:57.754082 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:23:57.754787 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:23:57.761105 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:57.761587 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:57.762018 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:57.762707 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:57.763189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:57.763609 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:57.994281 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:23:58.001967 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cd6b2097-411a-4d8b-bdc1-858699fac791 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1577 microversion: 2.1 time: 0.252820 Sep 02 09:23:58.002535 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 560/1131] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:23:57 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:23:59.023274 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:23:59.023895 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:23:59.030679 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:59.031185 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:59.031618 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:59.032309 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:59.032762 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:59.033205 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:59.056623 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-8131f5d9-a10c-4c18-8875-afc8780d1db2 req-425d1b8f-1769-49cc-9922-9ae8ac102fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ceaebed-8591-4b18-a14e-f5e78e05baf3", "name": "network-vif-deleted", "tag": "2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:23:59.067679 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8131f5d9-a10c-4c18-8875-afc8780d1db2 req-425d1b8f-1769-49cc-9922-9ae8ac102fac service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:59.068164 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8131f5d9-a10c-4c18-8875-afc8780d1db2 req-425d1b8f-1769-49cc-9922-9ae8ac102fac service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:59.068586 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-8131f5d9-a10c-4c18-8875-afc8780d1db2 req-425d1b8f-1769-49cc-9922-9ae8ac102fac service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:59.082136 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-8131f5d9-a10c-4c18-8875-afc8780d1db2 req-425d1b8f-1769-49cc-9922-9ae8ac102fac service nova] Creating event network-vif-deleted:2af0ab2a-11c6-4f1f-9af7-2b2078ab3dee for instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 on hv-cinder-85535 Sep 02 09:23:59.089210 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-8131f5d9-a10c-4c18-8875-afc8780d1db2 req-425d1b8f-1769-49cc-9922-9ae8ac102fac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035985 Sep 02 09:23:59.090108 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 561/1132] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:23:59.107833 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:23:59.116476 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e151c4d6-bf42-42ca-9779-dc299e692d0a tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 200 len: 1391 microversion: 2.1 time: 0.097040 Sep 02 09:23:59.117243 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 572/1133] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:23:59 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 1391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:24:00.138604 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:00.139332 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 3ceaebed-8591-4b18-a14e-f5e78e05baf3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:24:00.145358 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:00.145842 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:00.146276 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:00.146961 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:00.147437 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:00.147863 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:00.160560 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] HTTP exception thrown: Instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 could not be found. Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Request method failure captured: Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 HTTP/1.1 Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcocT3knZepyiG8HgZxMVxJAmyjdsu2MEeYB7t8txTvEFmTALGb3IJH4aTjoh0aJhsK6b6veWgz4L2Qb0aJJOZFzqDNW4kj9SHdWeT8rhJkbuvZZ2Qj6UNWcsfKjePiyNjR-IAivWWPnAc0HvG-nskvrMmJbhNV3YFaBzZbgPNHj6uI Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:24:00.162130 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a09b3fcd4fdc424086b7ca6b15d0a4e9", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 7e1f6e80465a44d0a90200ada3f43e23 Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 could not be found. Sep 02 09:24:00.164025 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '3ceaebed-8591-4b18-a14e-f5e78e05baf3'} Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 could not be found. Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:24:00.165199 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 could not be found. Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 could not be found. Sep 02 09:24:00.166911 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:00.168490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Returning 404 to user: Instance 3ceaebed-8591-4b18-a14e-f5e78e05baf3 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:24:00.168490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f9724cbd-58db-4130-a738-97f5d57c1e6c tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3" status: 404 len: 111 microversion: 2.1 time: 0.029615 Sep 02 09:24:00.168490 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 562/1134] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:24:00 2022] GET /compute/v2.1/servers/3ceaebed-8591-4b18-a14e-f5e78e05baf3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:24:03.201146 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-dc36cb22-01ed-452b-9edc-ecb7b52d4daf req-01280a55-4c77-4494-b222-4ffc6bd6b638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32372892-f492-4315-bd22-32344e4a0023", "tag": "b153dace-d7dc-499b-8259-5cc5f57bc371"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:24:03.203598 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:03.206572 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:24:03.213013 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:03.213507 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:03.213940 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:03.214755 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:03.215178 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:03.216063 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:03.216743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dc36cb22-01ed-452b-9edc-ecb7b52d4daf req-01280a55-4c77-4494-b222-4ffc6bd6b638 service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:03.217301 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dc36cb22-01ed-452b-9edc-ecb7b52d4daf req-01280a55-4c77-4494-b222-4ffc6bd6b638 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:03.218482 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dc36cb22-01ed-452b-9edc-ecb7b52d4daf req-01280a55-4c77-4494-b222-4ffc6bd6b638 service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:03.229819 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-dc36cb22-01ed-452b-9edc-ecb7b52d4daf req-01280a55-4c77-4494-b222-4ffc6bd6b638 service nova] Creating event network-changed:b153dace-d7dc-499b-8259-5cc5f57bc371 for instance 32372892-f492-4315-bd22-32344e4a0023 on hv-cinder-85535 Sep 02 09:24:03.234991 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-dc36cb22-01ed-452b-9edc-ecb7b52d4daf req-01280a55-4c77-4494-b222-4ffc6bd6b638 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037516 Sep 02 09:24:03.235722 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 563/1135] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:24:03.243974 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:24:03.338067 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-756add48-6677-4e84-9c9b-b1ea6bd35958 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 204 len: 0 microversion: 2.1 time: 0.144481 Sep 02 09:24:03.339575 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 573/1136] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:24:03 2022] DELETE /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:24:03.351166 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:03.354355 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:24:03.362735 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:03.363272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:03.364732 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:03.365462 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:03.365990 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:03.366672 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:03.524842 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:24:03.533464 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4abb499b-9aa8-4df0-8b52-2cea74afa704 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1579 microversion: 2.1 time: 0.188416 Sep 02 09:24:03.534045 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 564/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:24:03 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1579 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:24:04.554335 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:04.555035 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:24:04.561280 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:04.561760 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:04.562193 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:04.562877 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:04.563359 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:04.563786 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:04.722272 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:24:04.729808 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-26159afa-42e0-41a4-b9eb-3a76c19ad455 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1579 microversion: 2.1 time: 0.179725 Sep 02 09:24:04.730369 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 574/1138] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:24:04 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:24:05.744015 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-dab3514d-18da-47a1-8686-2c3699f18c9d req-2fcb9997-4137-4759-8555-7a1c987c7b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32372892-f492-4315-bd22-32344e4a0023", "name": "network-vif-deleted", "tag": "b153dace-d7dc-499b-8259-5cc5f57bc371"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:24:05.751172 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:05.752051 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:24:05.753805 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dab3514d-18da-47a1-8686-2c3699f18c9d req-2fcb9997-4137-4759-8555-7a1c987c7b1e service nova] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:05.754272 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dab3514d-18da-47a1-8686-2c3699f18c9d req-2fcb9997-4137-4759-8555-7a1c987c7b1e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:05.754698 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dab3514d-18da-47a1-8686-2c3699f18c9d req-2fcb9997-4137-4759-8555-7a1c987c7b1e service nova] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:05.758915 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:05.760024 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:05.760699 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:05.762184 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:05.762649 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:05.763123 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:05.766715 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-dab3514d-18da-47a1-8686-2c3699f18c9d req-2fcb9997-4137-4759-8555-7a1c987c7b1e service nova] Creating event network-vif-deleted:b153dace-d7dc-499b-8259-5cc5f57bc371 for instance 32372892-f492-4315-bd22-32344e4a0023 on hv-cinder-85535 Sep 02 09:24:05.772360 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-dab3514d-18da-47a1-8686-2c3699f18c9d req-2fcb9997-4137-4759-8555-7a1c987c7b1e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031798 Sep 02 09:24:05.772967 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 565/1139] 10.222.0.36 () {64 vars in 1317 bytes} [Fri Sep 2 09:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:24:05.832429 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f6e80465a44d0a90200ada3f43e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09b3fcd4fdc424086b7ca6b15d0a4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:24:05.840336 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f589ba89-79c8-4fc3-bb10-14a1d98ca600 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 200 len: 1393 microversion: 2.1 time: 0.094533 Sep 02 09:24:05.840914 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 575/1140] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:24:05 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 1393 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:24:06.863693 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:06.864309 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: 32372892-f492-4315-bd22-32344e4a0023] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:24:06.870375 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:06.870857 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:06.871320 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:06.872010 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:06.872473 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:06.872897 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:06.886801 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] HTTP exception thrown: Instance 32372892-f492-4315-bd22-32344e4a0023 could not be found. Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Request method failure captured: Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 HTTP/1.1 Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcocT3knZepyiG8HgZxMVxJAmyjdsu2MEeYB7t8txTvEFmTALGb3IJH4aTjoh0aJhsK6b6veWgz4L2Qb0aJJOZFzqDNW4kj9SHdWeT8rhJkbuvZZ2Qj6UNWcsfKjePiyNjR-IAivWWPnAc0HvG-nskvrMmJbhNV3YFaBzZbgPNHj6uI Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:24:06.888451 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a09b3fcd4fdc424086b7ca6b15d0a4e9", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 7e1f6e80465a44d0a90200ada3f43e23 Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance 32372892-f492-4315-bd22-32344e4a0023 could not be found. Sep 02 09:24:06.890189 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': '32372892-f492-4315-bd22-32344e4a0023'} Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32372892-f492-4315-bd22-32344e4a0023 could not be found. Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:24:06.891162 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32372892-f492-4315-bd22-32344e4a0023 could not be found. Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32372892-f492-4315-bd22-32344e4a0023 could not be found. Sep 02 09:24:06.892755 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:06.894266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Returning 404 to user: Instance 32372892-f492-4315-bd22-32344e4a0023 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:24:06.894266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-65d5bc7d-2145-435c-9e80-d6045afc89df tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023" status: 404 len: 111 microversion: 2.1 time: 0.031587 Sep 02 09:24:06.894266 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 566/1141] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:24:06 2022] GET /compute/v2.1/servers/32372892-f492-4315-bd22-32344e4a0023 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:24:07.321870 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:07.322391 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:24:07.328882 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:07.329371 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:07.329803 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:07.330487 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:07.330942 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:07.331400 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:07.345187 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] HTTP exception thrown: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Request method failure captured: Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a HTTP/1.1 Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept: application/json Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Connection: close Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Length: 0 Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Content-Type: application/json Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Host: 10.222.0.36 Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjEcocT3knZepyiG8HgZxMVxJAmyjdsu2MEeYB7t8txTvEFmTALGb3IJH4aTjoh0aJhsK6b6veWgz4L2Qb0aJJOZFzqDNW4kj9SHdWeT8rhJkbuvZZ2Qj6UNWcsfKjePiyNjR-IAivWWPnAc0HvG-nskvrMmJbhNV3YFaBzZbgPNHj6uI Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Role: reader,member Sep 02 09:24:07.346836 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a09b3fcd4fdc424086b7ca6b15d0a4e9", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Id: 7e1f6e80465a44d0a90200ada3f43e23 Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: method: > Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: exception: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.348561 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: action_args: {'id': 'e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a'} Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:24:07.349546 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.351202 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.352852 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Returning 404 to user: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:24:07.352852 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d5b44c7d-8653-419c-a7f9-fe166489b459 tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 404 len: 111 microversion: 2.1 time: 0.030485 Sep 02 09:24:07.352852 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 576/1142] 10.222.0.36 () {58 vars in 1239 bytes} [Fri Sep 2 09:24:07 2022] DELETE /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:24:07.357685 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:07.358962 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] [instance: e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:24:07.364872 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:07.365394 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:07.365828 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:07.366514 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Acquiring lock "77b482fe-72b8-4cea-95b2-9e3933054e02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:24:07.366968 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:24:07.367420 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Lock "77b482fe-72b8-4cea-95b2-9e3933054e02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:24:07.380254 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] HTTP exception thrown: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Request method failure captured: Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a HTTP/1.1 Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept: application/json Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Connection: close Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Length: 0 Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Content-Type: application/json Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Host: 10.222.0.36 Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjEcocT3knZepyiG8HgZxMVxJAmyjdsu2MEeYB7t8txTvEFmTALGb3IJH4aTjoh0aJhsK6b6veWgz4L2Qb0aJJOZFzqDNW4kj9SHdWeT8rhJkbuvZZ2Qj6UNWcsfKjePiyNjR-IAivWWPnAc0HvG-nskvrMmJbhNV3YFaBzZbgPNHj6uI Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Role: reader,member Sep 02 09:24:07.381743 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a09b3fcd4fdc424086b7ca6b15d0a4e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a09b3fcd4fdc424086b7ca6b15d0a4e9", "adminURL": "http://10.222.0.36:8080"}]}] Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Id: a09b3fcd4fdc424086b7ca6b15d0a4e9 Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestVolumeBootPattern-45464667 Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Id: 7e1f6e80465a44d0a90200ada3f43e23 Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestVolumeBootPattern-45464667-project Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: method: > Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: exception: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.383508 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: action_args: {'id': 'e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a'} Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:24:07.384347 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. Sep 02 09:24:07.385677 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Sep 02 09:24:07.386891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Returning 404 to user: Instance e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:24:07.386891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-09f63797-a13f-4457-8c8b-59c9754aeccc tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a" status: 404 len: 111 microversion: 2.1 time: 0.029337 Sep 02 09:24:07.386891 dv-cinder-855359-2-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 567/1143] 10.222.0.36 () {58 vars in 1236 bytes} [Fri Sep 2 09:24:07 2022] GET /compute/v2.1/servers/e6c0bc39-f890-4b86-ad63-1c1da5ebcc6a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:24:08.667472 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-944e7466-0af4-4803-8a36-0e294489380b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] Calling method '.version_select at 0x7f54bc33b700>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:08.693584 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-944e7466-0af4-4803-8a36-0e294489380b tempest-TestVolumeBootPattern-45464667 tempest-TestVolumeBootPattern-45464667-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1541286053" status: 202 len: 0 microversion: 2.1 time: 0.029749 Sep 02 09:24:08.694350 dv-cinder-855359-2-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 577/1144] 10.222.0.36 () {58 vars in 1263 bytes} [Fri Sep 2 09:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1541286053 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)